Skip to interview prep
Apexed

70. A retrieval-augmented assistant gives a wrong answer. How would you distinguish a retrieval problem from an answer-generation problem?

MediumMachine learning basics

Technical
Show model answer

Check whether the authorized retrieved material contained sufficient correct evidence for the question. If the required evidence was absent, inspect retrieval and source coverage; if it was present, examine how the answer used or ignored it.

Evaluate these components separately using representative questions and adjudicated evidence. A single end-to-end score cannot locate every failure, and good retrieval does not establish that the final answer is correct or properly qualified.

What interviewers listen for

  • Check evidence availability first
  • Evaluate retrieval and answer use separately
  • Adjudicate representative failures
A retrieval-augmented assistant gives a wrong answer. How would you distinguish a retrieval problem from an answer-generation problem — Data & analytics intervi