33. How would you make data cleaning reproducible without hiding scientific judgement?
MediumData & reproducibility
Technical
Show model answer
Keep transformations explicit and versioned, including exclusions, unit conversions, joins and corrections. Separate automated rules from cases requiring review, and record the evidence and rationale for judgement-based decisions.
Test the pipeline on known examples and reconcile counts and key summaries before and after each important step. Another authorised person should be able to reproduce the result and understand why a record changed, not merely run an unexplained script.
What interviewers listen for
- Version explicit transformations
- Document judgement and exceptions
- Reconcile changes with checks