Lesson 4.3

Detecting and reducing hallucination

Split an answer into claims and check each against the retrieved passages.

12mAdvanced3.3k students

Overview

Faithfulness is measurable

Split an answer into claims and check each against the retrieved passages. Automating that check with a grader model gives you a faithfulness score you can track across releases.

Most hallucination in a RAG system is a retrieval failure in disguise: the passage was not there, and the model filled the gap. Check recall before rewriting the prompt.

Design for refusal. If saying "the documents do not cover this" is treated as a failure, the system will learn to guess instead, which is strictly worse.

In this lesson you will:

  • Score whether an answer is supported
  • Make refusal an acceptable outcome
  • Fix retrieval before blaming generation

Resources

Previous Lesson
Detecting and reducing hallucination — Retrieval-Augmented Generation in Practice — Vertex