Back to results for “Validation”
Machine Learning Fundamentals › Cross-Validation Techniques

What are common mistakes to avoid with Cross-Validation Techniques

Intermediate

Answer

A common mistake is applying cross validation after already tuning the model on the full dataset, which can still leak information and give overly confident results.
Real-world example A team building a disease prediction model uses five fold cross validation to make sure their reported accuracy is stable and not just the result of one favorable data split.

Common follow-ups: What is a validation set, What is overfitting, What is model evaluation