OpenAI·AI Engineer·Technical Phone Screen
- You have an LLM solving a math problem where the time to produce a correct answer follows a known heavy-tailed distribution. Can you design a restart strategy (abort and restart from scratch) that achieves a lower expected total time-to-correct than just letting a single attempt run to completion?
- For a single-threshold restart strategy where you abort and restart whenever elapsed time exceeds a fixed value T, derive the expected total time as a function of T and find the optimal T.
- Design a strategy that strictly outperforms the best single-threshold policy in terms of worst-case performance. Explain why your approach is better, whether it's a deterministic schedule of multiple restart thresholds or a randomized policy.
“The core insight they were fishing for is that heavy tails make restarts worthwhile.”