Contamination MapText / LLM / Model
Llama 3.3 70B
- Organisation
- Meta
- Family
- Llama · version 3.3
- Released
- 2024-12-04 (llama-models README launch date 12/04/2024 (the model card's 'Model Release Date' field is empty))
- Training cutoff
- 2023-12-01
Evidence
“The pretraining data has a cutoff of December 2023”
raw.githubusercontent.com · model card · Training Data / Data Freshness · retrieved 2026-10-15 - Checkpoints
- meta-llama/Llama-3.3-70B-Instruct
- Weights
- Open · Llama 3.3 Community License Agreement
- Links
- Model cardCode
Training data disclosure: Vague
Level determined for 13% of benchmark cells.
- TestTest data seen0
- SeenSeen, split unclear0
- TrainTraining data seen0
- Related data seen0
- NoNot seen2
- ?Unknown13
“A new mix of publicly available online data.”
“trillion tokens of data from publicly available sources”
Other declared training data
-
A new mix of publicly available online data. (broad web data: may contain benchmark test sets) · split: unknown
15T+ tokens.
Evidence
“A new mix of publicly available online data.”
raw.githubusercontent.com · model card · Model Details table · retrieved 2026-10-15 -
publicly available instruction datasets (broad web data: may contain benchmark test sets) · split: unknown · fine-tuning
Evidence
“The fine-tuning data includes publicly available instruction datasets, as well as over 25M synthetically generated examples.”
raw.githubusercontent.com · model card · Training Data / Overview · retrieved 2026-10-15 -
over 25M synthetically generated examples (not yet matched to a dataset) · split: unknown · fine-tuning
Evidence
“The fine-tuning data includes publicly available instruction datasets, as well as over 25M synthetically generated examples.”
raw.githubusercontent.com · model card · Training Data / Overview · retrieved 2026-10-15
Benchmark cells
Classic LLM benchmarks
Unknown MMLU (Measuring Massive Multitask Language Understanding) · training data not disclosed in enough detail
Unknown GSM8K (Grade School Math 8K) · training data not disclosed in enough detail
Unknown MATH (Mathematics Aptitude Test of Heuristics) · training data not disclosed in enough detail
Unknown HumanEval · training data not disclosed in enough detail
Unknown ARC-Challenge (AI2 Reasoning Challenge, Challenge Set) · training data not disclosed in enough detail
Unknown HellaSwag · training data not disclosed in enough detail
Unknown TruthfulQA · training data not disclosed in enough detail
Unknown WinoGrande · training data not disclosed in enough detail
Recent LLM benchmarks
Unknown GPQA Diamond · training data not disclosed in enough detail
Unknown MMLU-Pro · training data not disclosed in enough detail
Unknown LiveCodeBench (code generation, release_v6) · training data not disclosed in enough detail
Unknown SWE-bench Verified · training data not disclosed in enough detail
Not seen AIME 2024 · its test items were published from 2024-01-31, after the model's stated training-data cutoff (2023-12-01)
Evidence (4)
“The pretraining data has a cutoff of December 2023”
“2024 AIME I problems and solutions. The test was held on Wednesday, January 31 – Thursday, February 1, 2024.”
“AIME I (main AIME competition date): Thursday, Feb. 1, 2024 between 1:30 pm ET and 5:30 pm ET.”
“AIME II (alternate AIME competition date): Wednesday, Feb. 7, 2024 between 1:30 pm ET and 5:30 pm ET.”
Not seen AIME 2025 · its test items were published from 2025-02-06, after the model's stated training-data cutoff (2023-12-01)
Evidence (3)
“The pretraining data has a cutoff of December 2023”
“2025 AIME I problems and solutions. The test was held on Thursday, February 6, 2025.”
“This year the AIME I will take place on February 6, 2025, while the alternate AIME II will take place on February 12, 2025.”
Unknown MATH-500 · training data not disclosed in enough detail
Notes
Only the instruction-tuned 70B checkpoint is published. The card describes the same pre-training figures as Llama 3.1 (15T+ tokens, December 2023 cutoff) but does not say whether the base model is Llama 3.1 70B.
Sources
- Llama 3.3 MODEL_CARD.md (meta-llama/llama-models) · model card · retrieved 2026-10-15
- meta-llama/llama-models README (launch dates) · readme · retrieved 2026-10-15