Definition

The new categories test checks if there are new categories in the validation set which are not present in the training set for the categorical features.

Taxonomy

  • Category: Consistency.
  • Task types: Tabular classification, tabular regression.
  • Availability: .

Why it matters

  • If the validation set contains new categories, the model is not prepared to make good predictions for them.