Contamination Map Methodology

Time series / Model

Toto (2024 technical report)

Organisation
Datadog
Family
Toto
Released
2024-07-10 (arXiv v1 submission date (https://arxiv.org/abs/2407.07874).)
Weights
Closed
Links
Paper

Training data disclosure: Partial list

Level determined for 40% of benchmark cells.

“Of these, roughly three-quarters are anonymous observability metrics from the Datadog platform. The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“By making synthetic data approximately 5% of our training dataset”
arxiv.org · paper · Section 4.2 · retrieved 2026-10-15

Training corpora

Benchmark cells

GIFT-Eval

Unknown Jena Weather (GIFT-Eval) · training data not disclosed in enough detail

Unknown BizITObs - Application · training data not disclosed in enough detail

Unknown BizITObs - Service · training data not disclosed in enough detail

Unknown BizITObs - L2C · training data not disclosed in enough detail

Unknown Bitbrains - Fast Storage · training data not disclosed in enough detail

Unknown Bitbrains - rnd · training data not disclosed in enough detail

Seen, split unclear Restaurant (Recruit Restaurant Visitor Forecasting) · the dataset was used; the source does not say which part (via LOTSA (Large-scale Open Time Series Archive))

Evidence (2)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“Restaurant”
arxiv.org · paper · Appendix A, Table 17 (Others) · retrieved 2026-10-15

Unknown ETT1 (GIFT-Eval) · training data not disclosed in enough detail

Unknown ETT2 (GIFT-Eval) · training data not disclosed in enough detail

Seen, split unclear Loop Seattle (LibCity) · the dataset was used; the source does not say which part (via LOTSA (Large-scale Open Time Series Archive))

Evidence (2)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“Loop Seattle”
arxiv.org · paper · Appendix A, Table 13 (LibCity) · retrieved 2026-10-15

Seen, split unclear SZ-Taxi (LibCity) · the dataset was used; the source does not say which part (via LOTSA (Large-scale Open Time Series Archive))

Evidence (2)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“SZ-Taxi”
arxiv.org · paper · Appendix A, Table 13 (LibCity) · retrieved 2026-10-15

Seen, split unclear M_DENSE (LibCity) · the dataset was used; the source does not say which part (via LOTSA (Large-scale Open Time Series Archive))

Evidence (2)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“Rotterdam”
arxiv.org · paper · Appendix A, Table 13 (LibCity) · retrieved 2026-10-15

Unknown Solar (LSTNet, 137 Alabama PV plants) · training data not disclosed in enough detail

Seen, split unclear Hierarchical Sales (Mancuso et al., 2020) · the dataset was used; the source does not say which part (via LOTSA (Large-scale Open Time Series Archive))

Evidence (2)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“Hierarchical Sales”
arxiv.org · paper · Appendix A, Table 17 (Others) · retrieved 2026-10-15

Test data seen M4 Yearly · the whole dataset was used (via LOTSA (Large-scale Open Time Series Archive))

Evidence (4)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“M4 Yearly”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“For the following datasets, we include their entirety in LOTSA without a held-out test set for the following reasons:”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15
“M1 Yearly, M1 Quarterly, M3 Yearly, M3 Quarterly, M4 Yearly, M4 Quarterly, Tourism Yearly: Some time series in these datasets are too short after train/test splits, thus we do not split them”
arxiv.org · paper · Appendix A, Monash exceptions list · retrieved 2026-10-15

Test data seen M4 Quarterly · the whole dataset was used (via LOTSA (Large-scale Open Time Series Archive))

Evidence (4)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“M4 Quarterly”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“For the following datasets, we include their entirety in LOTSA without a held-out test set for the following reasons:”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15
“M1 Yearly, M1 Quarterly, M3 Yearly, M3 Quarterly, M4 Yearly, M4 Quarterly, Tourism Yearly: Some time series in these datasets are too short after train/test splits, thus we do not split them”
arxiv.org · paper · Appendix A, Monash exceptions list · retrieved 2026-10-15

Seen, split unclear M4 Monthly · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“M4 Monthly”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear M4 Weekly · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“M4 Weekly”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear M4 Daily · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“M4 Daily”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear M4 Hourly · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“M4 Hourly”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear Hospital · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“Hospital”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear COVID Deaths · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“COVID Deaths”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear US Births · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“US Births”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear Saugeen River Flow · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“Saugeen”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear Temperature Rain · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“Temperature Rain”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear KDD Cup 2018 · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“KDD Cup 2018”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Seen, split unclear Car Parts · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“Car Parts”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Unknown ElectricityLoadDiagrams20112014 (UCI) · training data not disclosed in enough detail

Long-horizon forecasting (ETT, Electricity, Traffic, Weather, Exchange, ILI)

Unknown ETTh1 · training data not disclosed in enough detail

Unknown ETTh2 · training data not disclosed in enough detail

Unknown ETTm1 · training data not disclosed in enough detail

Unknown ETTm2 · training data not disclosed in enough detail

Unknown Electricity (ECL, 321 clients) · training data not disclosed in enough detail

Seen, split unclear Traffic (PeMS San Francisco Bay, 862 sensors) · a training split was used; its overlap with this benchmark's test data is not established (via LOTSA (Large-scale Open Time Series Archive))

Evidence (3)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“Traffic Hourly”
arxiv.org · paper · Appendix A, Table 14 (Monash) · retrieved 2026-10-15
“apart from the exceptions listed below, we only include the train region in LOTSA, by holding out the final forecast horizon as the test set.”
arxiv.org · paper · Appendix A, Monash paragraph · retrieved 2026-10-15

Unknown Weather (Jena, 2020; Autoformer) · training data not disclosed in enough detail

Unknown Exchange-Rate · training data not disclosed in enough detail

Related data seen ILI (CDC influenza-like illness, national) · related dataset CDC FluView ILINet (LOTSA) was used (via LOTSA (Large-scale Open Time Series Archive))

Evidence (5)
“The remaining points come from the LOTSA dataset [15], a compilation of publicly-available time series datasets across many different domains.”
arxiv.org · paper · Section 4 · retrieved 2026-10-15
“CDC Fluview ILINet”
arxiv.org · paper · Appendix A, Table 17 (Others) · retrieved 2026-10-15
“includes the weekly recorded influenza-like illness (ILI) patients data from Centers for Disease Control and Prevention of the United States between 2002 and 2021”
arxiv.org · paper · Section 4 (Datasets) · retrieved 2026-10-15
“https://gis.cdc.gov/grasp/fluview/fluportaldashboard.html”
arxiv.org · paper · Section 4, footnote 4 · retrieved 2026-10-15
“CDC Fluview ILINet CDC Fluview WHO NREVSS”
arxiv.org · paper · Table 14 (dataset column) · retrieved 2026-10-15

Time-series anomaly detection

Unknown TSB-AD-U (TSB-AD univariate) · training data not disclosed in enough detail

Unknown TSB-AD-M (TSB-AD multivariate) · training data not disclosed in enough detail

Unknown UCR Time Series Anomaly Archive (Hexagon ML/UCR, KDD Cup 2021) · training data not disclosed in enough detail

Unknown Server Machine Dataset (SMD) · training data not disclosed in enough detail

Unknown Mars Science Laboratory (MSL) telemetry anomaly dataset · training data not disclosed in enough detail

Unknown Soil Moisture Active Passive (SMAP) telemetry anomaly dataset · training data not disclosed in enough detail

Unknown Pooled Server Metrics (PSM) · training data not disclosed in enough detail

Unknown Secure Water Treatment (SWaT) · training data not disclosed in enough detail

Unknown Yahoo S5 Labeled Anomaly Detection Dataset (Yahoo Webscope S5) · training data not disclosed in enough detail

Unknown Numenta Anomaly Benchmark (NAB) · training data not disclosed in enough detail

Time-series classification

Unknown UCR Time Series Classification Archive (2018) · training data not disclosed in enough detail

Unknown UEA Multivariate Time Series Classification Archive (2018) · training data not disclosed in enough detail

Notes

Model described in the July 2024 technical report; no weights released with it (the open checkpoint is Toto-Open-Base-1.0, a different training run). ~1T points: ~75% Datadog internal observability metrics, the rest LOTSA, plus ~5% synthetic. Evaluated zero-shot on LSF (ETTh1/2, ETTm1/2, Electricity, Weather) with no statement about LOTSA overlap.

Sources