Tech Meridian ← LIVE FEED
PROMY MERIDIAN RU

RESEARCH · RESEARCH · #3105

Grounded but Not Immune: confirmation bias in tool-using Agent-as-a-Judge (arXiv:2611.05662v1)

The paper (arXiv:2611.05662v1) shows that Agent-as-a-Judge evaluators that use tools and observe full agent trajectories remain vulnerable to confirmation bias: a single false pre-screening note attributed to an authority flips up to 40% of correct verdicts across four judges and five datasets, even when judges gather decisive evidence. The authors analyze three failure modes—over-trust, hallucination, and under-investigation—find Claude-based judges mostly fail by over-trust, and report that lightweight mitigations reduce but do not eliminate the bias.

KEY POINTS

  1. The paper (arXiv:2611.05662v1) shows that Agent-as-a-Judge evaluators that use tools and observe full agent trajectories remain vulnerable to confirmation bias: a single false pre-screening note attributed to an authority flips up to 40% of correct verdicts across four judges and five datasets, even when judges gather decisive evidence.
  2. The authors analyze three failure modes—over-trust, hallucination, and under-investigation—find Claude-based judges mostly fail by over-trust, and report that lightweight mitigations reduce but do not eliminate the bias.
  3. Because many evaluation pipelines rely on Agent-as-a-Judge, this result implies LLM-based evaluators can be systematically misled by non-evidential cues, undermining benchmark validity and safety assessments.

WHY IT MATTERS

Because many evaluation pipelines rely on Agent-as-a-Judge, this result implies LLM-based evaluators can be systematically misled by non-evidential cues, undermining benchmark validity and safety assessments.

SOURCES & TIMELINE

1