Databricks·Machine Learning Engineer·Technical Phone Screen
- Implement linear regression with gradient descent from scratch, no ML libraries. Should predict y from a feature matrix X, compute MSE loss, and support a configurable learning rate with early stopping.
- What happens to training when the learning rate is too large versus too small?
- How would you normalize features before running gradient descent, and why does it matter?
- Here is a buggy gradient descent implementation. Find and fix the bugs.
“The MSE normalization thing is where people slip up and I almost did too.”