68. Why is it misleading to compare a new cohort's 90-day retention with an older cohort after only 30 days?
EasyMetrics & analytics
Technical
Show model answer
The newer cohort has not had the same opportunity to reach the outcome. Treating users whose observation window is incomplete as retained or lost changes the meaning of the comparison.
Compare cohorts at a common age or use an appropriate time-to-event approach with analytical support. State eligibility, observation dates and the retention definition so readers understand which outcomes are actually observed.
What interviewers listen for
- Use comparable cohort ages
- Handle incomplete observation explicitly
- Publish dates and retention definitions