Lyft·AI Engineer·Technical Phone Screen
- Walk me through the differences between a generative transformer model like GPT or T5 and an embedding model like sentence-BERT or OpenAI's text-embedding series. Cover what each is trained to do, the training objectives, what the output actually is, typical use cases, and when you'd pick one over the other in something like a RAG system.
“This felt like five questions stapled together and I kind of answered them in the wrong order.”