Oracle·Machine Learning Engineer·Technical Phone Screen
May 2026
Oracle ML Engineer interview that was basically one big coding deep-dive into attention mechanisms. No fluff, just 'implement this from scratch and explain every decision.' Felt like a grad school exam more than a job interview.
- Implement multi-head self-attention from scratch in PyTorch or NumPy, without using any built-in attention modules. Walk through projecting inputs into Q, K, V, reshaping for multiple heads, computing scaled dot-product attention, and recombining the heads with a final linear projection. Also discuss how you'd handle causal and padding masks, and what the computational complexity looks like.
“This was the whole interview, basically.”