Tabular / Benchmark
TabArena TabArena-v0.1
Living benchmark for predictive machine learning on small-to-medium IID tabular data: 51 manually curated classification and regression datasets (500-250,000 training samples), hosted as OpenML tasks (dataset ids 46904-46980, task ids 363612-363712).
Test split: Outer evaluation splits are fixed OpenML tasks: 3-fold outer cross-validation (stratified by class for classification), repeated 10 times (30 splits) for datasets with fewer than 2,500 samples and 3 times (9 splits) otherwise. Models are tuned/validated with 8-fold inner cross-validation on each outer training fold. TabArena-Lite uses only the first outer split of every dataset. Every row of a dataset appears in some outer test fold, so any pre-training on the dataset overlaps test data.
Contamination matrix
- TestTest data seen0
- SeenSeen, split unclear10
- TrainTraining data seen0
- Related data seen0
- NoNot seen714
- ?Unknown143
Hover a cell for the reason; click it for the evidence.
Notes
As of 2026-10-15 the repository README describes TabArena-v0.1 (51 datasets) as the IID benchmark and BeyondArena (142 datasets incl. temporal and grouped tasks, arXiv 2606.30410) as a complementary benchmark that 'will superseed TabArena-v0.1 in the future'. BeyondArena is not covered here. TabArena-v0.1 datasets are re-uploads to OpenML with new ids, so other papers usually cite older OpenML ids for the same data.
Sources
- TabArena: A Living Benchmark for Machine Learning on Tabular Data (arXiv v4) · paper · retrieved 2026-10-15
- TabArena GitHub README · readme · retrieved 2026-10-15
- TabArena curated dataset metadata (curated_tabarena_dataset_metadata.csv) · code · retrieved 2026-10-15