81. Only a small fraction of users rate an assistant's answers. What can thumbs-up feedback establish?
MediumAnalysis & visualization
Technical
Show model answer
It describes the feedback supplied by users who chose to rate, under current exposure. Those ratings may overrepresent unusually satisfied or frustrated users and need not measure factual correctness.
Combine voluntary feedback with representative audits and task outcomes where permitted. Report rating coverage, changes in who responds and the questions being rated; do not turn a high positive-rating percentage into an unsupported claim that all answers have equivalent accuracy.
What interviewers listen for
- Report who rated and coverage
- Separate satisfaction from correctness
- Use complementary representative audits