Tabular / Benchmark

TabArena TabArena-v0.1

Living benchmark for predictive machine learning on small-to-medium IID tabular data: 51 manually curated classification and regression datasets (500-250,000 training samples), hosted as OpenML tasks (dataset ids 46904-46980, task ids 363612-363712).

Test split: Outer evaluation splits are fixed OpenML tasks: 3-fold outer cross-validation (stratified by class for classification), repeated 10 times (30 splits) for datasets with fewer than 2,500 samples and 3 times (9 splits) otherwise. Models are tuned/validated with 8-fold inner cross-validation on each outer training fold. TabArena-Lite uses only the first outer split of every dataset. Every row of a dataset appears in some outer test fold, so any pre-training on the dataset overlaps test data.

Contamination matrix

Dataset LimiXLimiX-2MitraMitra-v2Real-TabPFNReal-TabPFN-2.5TabDPTTabDPT v1.3TabDPT-Turbo (TabDPT v1.2)TabICLTabICL v1.1TabICLv2TabPFN v2TabPFN-2.5TabPFN-2.6TabPFN-3TabPFN-3.5
airfoil_self_noise No No No No ? No ? ? No No No No No No No No No
Amazon_employee_access No No No No Seen No Seen ? No No No No No No No No No
anneal No No No No ? No ? ? No No No No No No No No No
Another-Dataset-on-used-Fiat-500 No No No No ? No ? ? No No No No No No No No No
APSFailure No No No No ? No Seen ? No No No No No No No No No
bank-marketing No No No No Seen No ? ? No No No No No No No No No
Bank_Customer_Churn No No No No ? No ? ? No No No No No No No No No
Bioresponse No No No No ? No ? ? No No No No No No No No No
blood-transfusion-service-center No No No No ? No ? ? No No No No No No No No No
churn No No No No ? No ? ? No No No No No No No No No
coil2000_insurance_policies No No No No ? No ? ? No No No No No No No No No
concrete_compressive_strength No No No No ? No ? ? No No No No No No No No No
credit-g No No No No ? No ? ? No No No No No No No No No
credit_card_clients_default No No No No ? No ? ? No No No No No No No No No
customer_satisfaction_in_airline No No No No ? No ? ? No No No No No No No No No
diabetes No No No No ? No ? ? No No No No No No No No No
Diabetes130US No No No No ? No Seen ? No No No No No No No No No
diamonds No No No No ? No ? ? No No No No No No No No No
E-CommereShippingData No No No No ? No ? ? No No No No No No No No No
Fitness_Club No No No No ? No ? ? No No No No No No No No No
Food_Delivery_Time No No No No ? No ? ? No No No No No No No No No
GiveMeSomeCredit No No No No ? No ? ? No No No No No No No No No
hazelnut-spread-contaminant-detection No No No No ? No ? ? No No No No No No No No No
healthcare_insurance_expenses No No No No ? No ? ? No No No No No No No No No
heloc No No No No ? No Seen ? No No No No No No No No No
hiva_agnostic No No No No ? No ? ? No No No No No No No No No
houses No No No No ? No ? ? No No No No No No No No No
HR_Analytics_Job_Change_of_Data_Scientists No No No No ? No ? ? No No No No No No No No No
in_vehicle_coupon_recommendation No No No No ? No ? ? No No No No No No No No No
Is-this-a-good-customer No No No No ? No ? ? No No No No No No No No No
kddcup09_appetency No No No No ? No Seen ? No No No No No No No No No
Marketing_Campaign No No No No ? No ? ? No No No No No No No No No
maternal_health_risk No No No No ? No ? ? No No No No No No No No No
miami_housing No No No No ? No ? ? No No No No No No No No No
MIC No No No No ? No ? ? No No No No No No No No No
NATICUSdroid No No No No ? No ? ? No No No No No No No No No
online_shoppers_intention No No No No Seen No ? ? No No No No No No No No No
physiochemical_protein No No No No ? No ? ? No No No No No No No No No
polish_companies_bankruptcy No No No No ? No ? ? No No No No No No No No No
qsar-biodeg No No No No ? No ? ? No No No No No No No No No
QSAR-TID-11 No No No No ? No Seen ? No No No No No No No No No
QSAR_fish_toxicity No No No No ? No ? ? No No No No No No No No No
SDSS17 No No No No ? No ? ? No No No No No No No No No
seismic-bumps No No No No ? No ? ? No No No No No No No No No
splice No No No No ? No ? ? No No No No No No No No No
students_dropout_and_academic_success No No No No ? No ? ? No No No No No No No No No
superconductivity No No No No ? No ? ? No No No No No No No No No
taiwanese_bankruptcy_prediction No No No No ? No ? ? No No No No No No No No No
website_phishing No No No No ? No ? ? No No No No No No No No No
wine_quality No No No No ? No Seen ? No No No No No No No No No
jm1 No No No No ? No ? ? No No No No No No No No No

Hover a cell for the reason; click it for the evidence.

Notes

As of 2026-10-15 the repository README describes TabArena-v0.1 (51 datasets) as the IID benchmark and BeyondArena (142 datasets incl. temporal and grouped tasks, arXiv 2606.30410) as a complementary benchmark that 'will superseed TabArena-v0.1 in the future'. BeyondArena is not covered here. TabArena-v0.1 datasets are re-uploads to OpenML with new ids, so other papers usually cite older OpenML ids for the same data.

Sources