Training-validation leakage

​

Definition

The training-validation lekage test allows you to detect training rows that are also present in the validation dataset.

​

Taxonomy

• Category: Consistency.
• Task types: LLM, tabular classification, tabular regression, text classification.
• Availability: development.

​

Why it matters

• The training and validation datasets must be completely disjoint. Otherwise, all evaluation insights extracted from the validation set are unreliable and overly optimistic.