Text / LLM / Model
Llama 3.2 (1B, 3B)
- Organisation
- Meta
- Family
- Llama · version 3.2
- Released
- 2024-09-25 (llama-models README launch date 9/25/2024 for Llama 3.2 1B/3B; the text model card says 'Model Release Date: Oct 24, 2024' (the date the quantized checkpoints were added))
- Training cutoff
- 2023-12-01
Evidence
“The pretraining data has a cutoff of December 2023”
raw.githubusercontent.com · model card · Training Data / Data Freshness · retrieved 2026-10-15 - Checkpoints
- meta-llama/Llama-3.2-1B, meta-llama/Llama-3.2-3B, meta-llama/Llama-3.2-1B-Instruct, meta-llama/Llama-3.2-3B-Instruct, meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8, meta-llama/Llama-3.2-1B-Instruct-QLORA_INT4_EO8, meta-llama/Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8, meta-llama/Llama-3.2-3B-Instruct-QLORA_INT4_EO8
- Weights
- Open · Llama 3.2 Community License
- Links
- Model cardCode
Training data disclosure: Vague
Level determined for 13% of benchmark cells.
- TestTest data seen0
- SeenSeen, split unclear0
- TrainTraining data seen0
- Related data seen0
- NoNot seen2
- ?Unknown13
“Llama 3.2 was pretrained on up to 9 trillion tokens of data from publicly available sources.”
Other declared training data
-
A new mix of publicly available online data. (broad web data: may contain benchmark test sets) · split: unknown
Evidence
“A new mix of publicly available online data.”
raw.githubusercontent.com · model card · Model Details table · retrieved 2026-10-15 “Llama 3.2 was pretrained on up to 9 trillion tokens of data from publicly available sources.”
raw.githubusercontent.com · model card · Training Data / Overview · retrieved 2026-10-15 -
logits from Llama 3.1 8B and 70B (knowledge distillation) (not yet matched to a dataset) · split: unknown
Teacher-model outputs, not a dataset; see llama-3.1 for the teachers' contamination findings.
Evidence
“For the 1B and 3B Llama 3.2 models, we incorporated logits from the Llama 3.1 8B and 70B models into the pretraining stage of the model development, where outputs (logits) from these larger models were used as token-level targets.”
raw.githubusercontent.com · model card · Training Data / Overview · retrieved 2026-10-15 -
human-generated data from vendors combined with synthetic data (not yet matched to a dataset) · split: unknown · fine-tuning
Evidence
“We employ a multi-faceted approach to data collection, combining human-generated data from our vendors with synthetic data to mitigate potential safety risks.”
raw.githubusercontent.com · model card · Responsibility & Safety / Fine-Tuning Data · retrieved 2026-10-15 “In post-training we used a similar recipe as Llama 3.1 and produced final chat models by doing several rounds of alignment on top of the pre-trained model.”
raw.githubusercontent.com · model card · Training Data / Overview · retrieved 2026-10-15
Benchmark cells
Classic LLM benchmarks
Unknown MMLU (Measuring Massive Multitask Language Understanding) · training data not disclosed in enough detail
Unknown GSM8K (Grade School Math 8K) · training data not disclosed in enough detail
Unknown MATH (Mathematics Aptitude Test of Heuristics) · training data not disclosed in enough detail
Unknown HumanEval · training data not disclosed in enough detail
Unknown ARC-Challenge (AI2 Reasoning Challenge, Challenge Set) · training data not disclosed in enough detail
Unknown HellaSwag · training data not disclosed in enough detail
Unknown TruthfulQA · training data not disclosed in enough detail
Unknown WinoGrande · training data not disclosed in enough detail
Recent LLM benchmarks
Unknown GPQA Diamond · training data not disclosed in enough detail
Unknown MMLU-Pro · training data not disclosed in enough detail
Unknown LiveCodeBench (code generation, release_v6) · training data not disclosed in enough detail
Unknown SWE-bench Verified · training data not disclosed in enough detail
Not seen AIME 2024 · its test items were published from 2024-01-31, after the model's stated training-data cutoff (2023-12-01)
Evidence (4)
“The pretraining data has a cutoff of December 2023”
“2024 AIME I problems and solutions. The test was held on Wednesday, January 31 – Thursday, February 1, 2024.”
“AIME I (main AIME competition date): Thursday, Feb. 1, 2024 between 1:30 pm ET and 5:30 pm ET.”
“AIME II (alternate AIME competition date): Wednesday, Feb. 7, 2024 between 1:30 pm ET and 5:30 pm ET.”
Not seen AIME 2025 · its test items were published from 2025-02-06, after the model's stated training-data cutoff (2023-12-01)
Evidence (3)
“The pretraining data has a cutoff of December 2023”
“2025 AIME I problems and solutions. The test was held on Thursday, February 6, 2025.”
“This year the AIME I will take place on February 6, 2025, while the alternate AIME II will take place on February 12, 2025.”
Unknown MATH-500 · training data not disclosed in enough detail
Notes
1B/3B models were obtained with pruning and knowledge distillation from Llama 3.1 8B/70B (model card). No contamination analysis published for this release.
Sources
- Llama 3.2 MODEL_CARD.md (meta-llama/llama-models) · model card · retrieved 2026-10-15
- meta-llama/llama-models README (launch dates) · readme · retrieved 2026-10-15