48. A campaign holdout accidentally receives the same offer through another team’s email. What does that mean for the study?
MediumAnalytics & budget
Case
Show model answer
The control no longer represents the intended absence of that offer, so the contrast and its interpretation have changed. Establish which groups received what, when, and whether the contamination differs systematically across the study.
Consult the measurement owner on valid analysis or a revised test, preserving assignment and exposure records. Do not quietly remove inconvenient recipients or report the original design as though the contamination never occurred.
What interviewers listen for
- Establish the actual control experience
- Preserve assignment and exposure evidence
- Reassess interpretation with the measurement owner