Adobe·Machine Learning Engineer·Technical Phone Screen
- Why are transformer models considered memory-bound rather than compute-bound, and what does that mean in practice?
- What is the cost of materializing the full attention matrix, and how does that affect system design decisions?
- Can you explain HFU and MFU and how you'd use them to evaluate GPU efficiency?
- How would you identify and address GPU underutilization in a training or inference workload?
- What is kernel fusion and when would you use it? How do CUDA graphs fit into that picture?
“This is where I felt most confident.”