← Airbnb Interview InsightsMachine Learning Engineer

Airbnb·Machine Learning Engineer·Onsite - System Design / Architecture·Senior

SeniorPrefer not to say
Jun 2026

Summary

ML system design round at Airbnb for an MLE role. The question was meaty and touched basically every layer of the stack, from label construction to serving to fairness guardrails. Felt like a senior-level bar.

Questions Asked (1)

Q1

Design an ML system to identify high-quality Airbnb listings so they can be surfaced more prominently in search and recommendations, while low-quality ones get flagged or coached.

System DesignA/B Testing & ExperimentationTechnical Trade-offs
Author's notes

This one sprawled fast.

Create a free account to read the full note

AI HintsAI Generated

Suggested Approach

Start by clarifying the business goal: define what 'high-quality' means for Airbnb listings, likely a combination of guest satisfaction, booking conversion, and host reliability. Then outline an end-to-end ML system: data collection, feature engineering, model training, evaluation, and deployment with feedback loops. Emphasize experimentation and trade-offs, such as balancing search ranking improvements with host fairness and business metrics.

Pro tip: Frame the problem as a ranking and classification task, but highlight the importance of defining a clear, measurable quality score that aligns with Airbnb's business objectives. Discuss how you would validate the model offline and online, and how you'd handle potential biases or feedback loops.

1. Define Quality and Objectives

Clarify what constitutes a high-quality listing by working with stakeholders to identify key signals (e.g., review scores, booking rates, cancellation rates, host responsiveness). Define success metrics such as increased bookings, higher guest satisfaction, and reduced low-quality listings.

2. Data Collection and Feature Engineering

Identify data sources: listing attributes, host history, guest reviews, booking and search logs, and external data. Engineer features that capture quality, such as sentiment from reviews, response time, cancellation rate, and photo quality scores.

3. Model Development and Evaluation

Choose appropriate models: a regression model to predict a continuous quality score, or a classification model to flag low-quality listings. Use offline evaluation with metrics like AUC, NDCG, or precision@k, and validate with business metrics.

4. Deployment and Integration

Deploy the model as a service that scores listings in real-time or batch. Integrate scores into search ranking and recommendation systems, and create a feedback loop to flag low-quality listings for coaching or removal.

5. Experimentation and Iteration

Design A/B tests to measure the impact of surfacing high-quality listings on business metrics. Monitor for unintended consequences, such as reduced diversity or fairness issues, and iterate on the model and features.

Key Points to Mention

  • Define a clear, multi-faceted quality score that combines guest reviews, booking behavior, and host reliability.
  • Use a combination of offline evaluation (e.g., NDCG for ranking) and online A/B testing to validate model performance.
  • Address potential biases and feedback loops, such as popularity bias or self-reinforcing quality signals.
  • Consider trade-offs between search ranking improvements and host fairness, ensuring low-quality flags are actionable and not punitive.
  • Implement a feedback loop where flagged listings receive coaching, and monitor the effectiveness of interventions.
  • Discuss scalability and latency requirements for real-time scoring in search and recommendations.

AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.