Skip to interview prep
Apexed

68. Why is it misleading to compare a new cohort's 90-day retention with an older cohort after only 30 days?

EasyMetrics & analytics

Technical
Show model answer

The newer cohort has not had the same opportunity to reach the outcome. Treating users whose observation window is incomplete as retained or lost changes the meaning of the comparison.

Compare cohorts at a common age or use an appropriate time-to-event approach with analytical support. State eligibility, observation dates and the retention definition so readers understand which outcomes are actually observed.

What interviewers listen for

  • Use comparable cohort ages
  • Handle incomplete observation explicitly
  • Publish dates and retention definitions
Why is it misleading to compare a new cohort's 90-day retention with an older cohort after only 30 days — Product management interview question — Apexed