Reading up on local-llm-judge
1 deep · digging since sep 17
- Classic ML to cope with Dumb LLM Judges
Combining many low‑confidence LLM relevance judgments via a decision tree boosts precision for e‑commerce search relevance, achieving up to ~96.5% precision on ~40% of test pairs.