Skip to interview prep
Apexed

75. An assistant improves its accuracy by refusing more requests. How would you decide whether the change is useful?

MediumBusiness cases

Case
Show model answer

Report accuracy among answered requests together with answer coverage, refusal quality and error severity. A system that answers only easy requests can look more accurate while completing less of the intended work.

Compare candidates on the same request population and examine which users or task categories lose service. Define acceptable escalation paths and quality-coverage tradeoffs with the product owner rather than declaring a win from conditional accuracy alone.

What interviewers listen for

  • Report quality and coverage together
  • Compare the same request population
  • Inspect refusal and escalation outcomes
An assistant improves its accuracy by refusing more requests. How would you decide whether the change is useful — Data & analytics interview question — Apexed