77. A model predicts account losses very accurately using fields updated after the loss was known. How would you assess it?
MediumProblem structuring
Case
Show model answer
The evaluation may contain information unavailable at the time a real prediction would be made. Identify the actual decision point and reconstruct what each input would have contained then.
Rebuild a suitable time-consistent evaluation and check preprocessing and related records for leakage. Report the corrected evidence rather than using retrospective accuracy as proof the client can reliably intervene before a future loss.
What interviewers listen for
- Identify information available at the prediction time
- Rebuild a time-consistent evaluation
- Separate hindsight accuracy from usable foresight