Netflix·Machine Learning Engineer·Technical Phone Screen
- Walk me through how self-attention works in a Transformer, including how Q, K, and V are derived, the actual attention formula, how multi-head attention builds on top of it, and why this architecture handles long-range dependencies better than RNNs.
“This is one of those questions where you think you know it and then halfway through your explanation you realize you're not sure you're saying anything precise.”