12 min read
Thirty test cases cannot tell ninety per cent from eighty
A working demo tells you nothing about your next change. How to build an evaluation set from real questions, score retrieval separately from the answer, calibrate the judge, and gate every prompt change in CI.
- Evaluation
- LLMs