Spotify·Machine Learning Engineer·Onsite - System Design / Architecture
May 2026
Spotify ML Engineer interview that went deep on a single end-to-end system design problem around predicting free-to-premium conversion. The whole session was basically one long question with the interviewer probing every layer you could imagine, from how you define the label to how you'd run the A/B test.
- Design an end-to-end ML system that identifies which free-tier users are most likely to convert to premium, or at least start behaving like premium users.
- How would you define the positive label for this conversion prediction task, and what time horizon would you use?
- What data sources and user events would you pull in as features, and how would you handle class imbalance given that most free users never convert?
- Walk through your choice of model architecture for this problem and explain why you'd pick it over the alternatives.
- Which offline metrics would you use to evaluate this model, and how do they connect to the online metrics you'd actually care about in production?
- How would you design the A/B test to validate that this model actually drives incremental conversions?
“This is the kind of question where you think you know where to start and then realize there are five different ways to frame it before you even touch a model.”