70. A service queues every request during a traffic surge and takes hours to recover. How would you redesign overload behavior?
HardSystem design
Technical
Show model answer
Establish which requests can be delayed, rejected or degraded and what deadlines matter. Measure arrival rate, service capacity, queue age and bottlenecks. Unbounded queuing hides overload while increasing memory use and making results arrive too late to be useful.
Use bounded queues, admission control, backpressure and fair limits, with explicit retry guidance. Preserve capacity for critical work and recovery. Load-test sustained overload and recovery, including retry amplification, and validate that shedding work meets the agreed business priorities.
What interviewers listen for
- Bound queue age and size
- Prioritized admission
- Avoid retry amplification
- Test recovery