deployed_

the weeks / Week 3 · Project 2

Project 2 begins: ground truth first

You build the exam before you build the student.

Messy real documents in, clean validated records out, graded against labels you never see. This week is the part beginners skip and professionals never do: hand-label a set of rows yourself, split it into teaching examples and a held-back test, and write the eval your pipeline must pass before the pipeline exists. Real data will lie to you in layers; this is the week you learn to catch it.

It ends with

A labeled set, an eval written by you, and a pipeline taking shape against it.

Field notes

  • 4.3 How do examples teach a model what you mean? program
  • 4.4 How do you know your new prompt is better and not just different? program
  • 8.2 Why is real-world data always messier than the demo data? program
  • 7.4 What is a skill, and how does an agent learn your way of working? program