Skip to interview prep
Apexed

81. Only a small fraction of users rate an assistant's answers. What can thumbs-up feedback establish?

MediumAnalysis & visualization

Technical
Show model answer

It describes the feedback supplied by users who chose to rate, under current exposure. Those ratings may overrepresent unusually satisfied or frustrated users and need not measure factual correctness.

Combine voluntary feedback with representative audits and task outcomes where permitted. Report rating coverage, changes in who responds and the questions being rated; do not turn a high positive-rating percentage into an unsupported claim that all answers have equivalent accuracy.

What interviewers listen for

  • Report who rated and coverage
  • Separate satisfaction from correctness
  • Use complementary representative audits
Only a small fraction of users rate an assistant's answers. What can thumbs-up feedback establish — Data & analytics interview question — Apexed