83. A prompt revision fixes one task but breaks previously reliable behavior. How would you make prompt changes reviewable?
MediumTesting & engineering practice
Technical
Show model answer
Version the prompt alongside its model configuration, tools and evaluation data. Compare the candidate with the current release on both the reported failure and representative existing tasks, including important negative cases.
Inspect regressions by failure type rather than accepting a higher average alone. Set release guardrails, retain the previous configuration, and document what was actually evaluated so a later rollback restores a coherent system.
What interviewers listen for
- Version the whole configuration
- Check regressions beyond averages
- Retain a coherent rollback target