← Adobe Interview InsightsMachine Learning Engineer
This question started simple and then just kept expanding.
Define data leakage as any information in training that wouldn't be available at prediction time, then systematically walk through each form with concrete examples and detection/prevention strategies. Emphasize that leakage often stems from improper data splitting or feature engineering and can be caught by rigorous validation and monitoring.
Pro tip: Always simulate production conditions by splitting data temporally or by entity, and use pipelines to encapsulate all preprocessing steps to avoid leakage. Mention that leakage can also occur in feature stores or online serving, so consistency between training and serving is key.
Explain that data leakage occurs when a model uses information during training that will not be available at inference time, leading to overly optimistic performance and poor generalization.
Describe target leakage, train/test contamination, time-based leakage, and preprocessing leakage, giving a concrete example for each.
For each form, outline how to detect it: e.g., unexpected feature importance, performance drop on holdout, temporal validation, and pipeline audits.
Detail prevention: use pipelines, split data before preprocessing, respect temporal order, avoid using future data, and validate with proper cross-validation.
Discuss how to maintain consistency between training and serving, monitor for leakage in production, and conduct code reviews to catch subtle issues.
AI-generated suggestions, not part of the candidate's original notes. May be inaccurate — verify before relying on them.