← Pinterest Interview InsightsMachine Learning Engineer

Pinterest·Machine Learning Engineer·Technical Phone Screen·Intermediate

Intermediate
Jun 2026

Summary

Pinterest ML engineer interview had at least one multiple-choice question on confusion matrices. Pretty straightforward topic on paper but the question was designed to catch people who autopilot through the axis conventions.

Questions Asked (1)

Q1

Given a confusion matrix, compute precision, recall, F1, accuracy, and specificity. Also interpret which cells represent TP, FP, FN, and TN given the axis layout shown.

Product Analytics & MetricsTechnical Trade-offs
Author's notes

The multiple-choice format made me overconfident and I nearly picked the wrong answer because I assumed the predicted axis was on the rows without actually checking.

Create a free account to read the full note

AI HintsAI Generated

Suggested Approach

First, clarify the confusion matrix layout (e.g., rows = actual, columns = predicted) and define TP, FP, FN, TN accordingly. Then compute each metric using their formulas, showing step-by-step calculations. Finally, interpret the metrics in the context of the problem, discussing trade-offs and business implications.

Pro tip: Always state your assumptions about the matrix orientation before computing; this prevents errors and shows attention to detail. Also, relate the metrics to the business context (e.g., Pinterest's recommendation system) to demonstrate practical understanding.

1. Clarify matrix orientation

Confirm whether rows represent actual classes and columns predicted classes (or vice versa). Define TP, FP, FN, TN based on this layout.

2. Compute core metrics

Calculate precision (TP/(TP+FP)), recall (TP/(TP+FN)), F1 (2*precision*recall/(precision+recall)), accuracy ((TP+TN)/total), and specificity (TN/(TN+FP)).

3. Interpret metrics in context

Explain what each metric means for the specific problem, e.g., high precision vs. recall trade-off, and how they relate to business goals like user engagement or content moderation.

4. Discuss trade-offs and limitations

Mention when accuracy is misleading (e.g., imbalanced classes), and how F1 balances precision and recall. Suggest alternative metrics if needed.

Key Points to Mention

  • Definition of TP, FP, FN, TN based on matrix axes
  • Formulas for precision, recall, F1, accuracy, specificity
  • Impact of class imbalance on accuracy
  • Trade-off between precision and recall and how F1 captures it
  • Business context: e.g., false positives vs. false negatives cost in Pinterest's use case
  • Potential need for additional metrics like AUC-ROC or PR-AUC

AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.