Your LLM-as-judge eval set is too small. Here is the math.

Your LLM-as-judge eval set is too small. Here is the math.

#dsp

Articles tagged with #dsp

I benchmarked 6 prompt-optimization frameworks on the same task. Here is what each one actually optimizes.
“Prompt optimization” spans random search to evolutionary Pareto fronts. The deciding question is what it optimizes against: your metric on your data, or a generic proxy.
Jun 19, 20264 min read1