OpenAI AI Engineer interview questions

4 AI Engineers have shared notes from their OpenAI interviews, with the questions they were asked in each round. That is 1% of the 413 OpenAI interview notes on Screna AI.

4 AI Engineer interview notes

OpenAI·AI Engineer·Technical Phone Screen

Jun 2026
OpenAI AI Engineer interview with a math-heavy probability question about restart strategies for LLM inference. Pretty niche stuff, felt more like a theory seminar than a typical coding screen.
  • You have an LLM solving a math problem where the time to produce a correct answer follows a known heavy-tailed distribution. Can you design a restart strategy (abort and restart from scratch) that achieves a lower expected total time-to-correct than just letting a single attempt run to completion?
  • For a single-threshold restart strategy where you abort and restart whenever elapsed time exceeds a fixed value T, derive the expected total time as a function of T and find the optimal T.
  • Design a strategy that strictly outperforms the best single-threshold policy in terms of worst-case performance. Explain why your approach is better, whether it's a deterministic schedule of multiple restart thresholds or a randomized policy.

“The core insight they were fishing for is that heavy tails make restarts worthwhile.”

View Post

OpenAI·AI Engineer·Technical Phone Screen

May 2026
OpenAI AI Engineer technical screen focused entirely on numerical computing for ML, specifically entropy over a softmax distribution. Two parts: get a stable closed-form implementation, then extend it to a streaming setting with incremental updates. Pretty deep for a phone screen.
  • Given a vector of logits, compute the entropy of the softmax distribution in a numerically stable way, avoiding overflow in the exponentiation and underflow in the log.
  • Now logits arrive one at a time in a stream. Maintain the entropy of the running softmax after each new logit without recomputing everything from scratch. Walk through the update rule and discuss where things can go wrong numerically.

“The naive version blows up fast and I knew that going in, so I started with the log-sum-exp trick right away.”

View Post

OpenAI·AI Engineer·Technical Phone Screen

Apr 2026
Interviewed for an AI Engineer role at OpenAI and got hit with a pretty gnarly algorithmic design problem about generating balanced assignment sequences across three tag dimensions. Not your typical leetcode grind, more like a combinatorics-meets-systems-thinking puzzle that made me question my life choices halfway through.
  • Given three finite tag dimensions (AI, Human, Task), generate a sequence of N assignment triples such that at every prefix length, the difference between the max and min counts of any (AI, Human) pair and any (AI, Task) pair is at most 1. Walk through your approach.

“I stared at this for a solid 30 seconds before saying anything.”

View Post

OpenAI·AI Engineer·Technical Phone Screen

Apr 2026
OpenAI AI Engineer interview with a pretty brutal multi-part coding problem centered on matrix multiplication and autograd. Four parts, escalating difficulty, and the last one on parallel prefix scan was not something I had mentally prepared for.
  • Implement an in-place matrix multiplication routine for a chain of square matrices, then explain why it breaks backpropagation.
  • Rewrite the matrix multiplication chain as an out-of-place operation that is compatible with automatic differentiation.
  • Manually implement the backward pass for the matrix multiplication chain without relying on any autograd framework.
  • Implement both the forward and backward passes for the matrix chain product using a Hillis-Steele parallel prefix scan pattern.

“The implementation part was fine, pretty mechanical.”

View Post