34. Customers receiving a loyalty offer spend more than others. How would you assess whether the offer caused additional spending?
HardStatistics & experiments
Technical
Show model answer
Investigate why customers received the offer, when eligibility was determined and what spending was measured. Existing high-value customers may have been targeted, and measuring only redeemers introduces further selection. Compare pre-offer behavior and concurrent business changes.
Prefer a prospective randomized holdout if feasible. With observational data, choose a defensible comparison design and state its identifying assumptions, then test sensitivity and pre-period patterns where relevant. Report incremental profit and uncertainty, including offer cost, rather than equating recipient spend with impact.
What interviewers listen for
- Understand assignment
- Credible counterfactual
- Explicit assumptions
- Incremental economics