Confidence Calibration and Abstention Logic in Grounded Agents
Models withhold uncertainty when tasked to be helpful, even when they know better.
Priya Subramaniam
Section
6 stories in Grounding & Hallucinations.
Models withhold uncertainty when tasked to be helpful, even when they know better.
Re-ranking retrieval results puts high-confidence chunks where models actually attend to them.
Decompose RAG answers into claims to catch fabrications that end-to-end scores miss.
Models confidently hallucinate answers about facts beyond their training window.
LLM agents need richer passages than search snippets provide to reason accurately and cite sources.
How AI agents hide citation failures behind the appearance of grounded responses.