The LLM Judge Agrees With Humans 85% of the Time. Here Is What That Number Hides.

LLM evaluation breaks down when the task is subjective. A judge model can be consistent, fast and cheap, and still be measuring something… Continue reading on Medium »