Text / LLM / Model
Llama 3.2-Vision (11B, 90B)
- Organisation
- Meta
- Family
- Llama · version 3.2
- Released
- 2024-09-25 (Model card 'Model Release Date: Sept 25, 2024' (MODEL_CARD_VISION.md) and llama-models README launch date 9/25/2024)
- Training cutoff
- 2023-12-01
Evidence
“The pretraining data has a cutoff of December 2023”
raw.githubusercontent.com · model card · Training Data / Data Freshness · retrieved 2026-10-15 - Checkpoints
- meta-llama/Llama-3.2-11B-Vision, meta-llama/Llama-3.2-90B-Vision, meta-llama/Llama-3.2-11B-Vision-Instruct, meta-llama/Llama-3.2-90B-Vision-Instruct
- Weights
- Open · Llama 3.2 Community License
- Links
- Model cardCode
Training data disclosure: Vague
Level determined for 13% of benchmark cells.
- TestTest data seen0
- SeenSeen, split unclear0
- TrainTraining data seen0
- Related data seen0
- NoNot seen3
- ?Unknown19
“Llama 3.2-Vision was pretrained on 6B image and text pairs.”
Other declared training data
-
6B image and text pairs (not yet matched to a dataset) · split: unknown
Source of the pairs not described.
Evidence
“Llama 3.2-Vision was pretrained on 6B image and text pairs.”
raw.githubusercontent.com · model card · Training Data / Overview · retrieved 2026-10-15 -
Llama 3.1 text-only model (base language model) (not yet matched to a dataset) · split: unknown
Inherits the Llama 3.1 language model and therefore its pre-training data; see llama-3.1.
Evidence
“Llama 3.2-Vision is built on top of the Llama 3.1 text-only model”
raw.githubusercontent.com · model card · Model Information / Model Architecture · retrieved 2026-10-15 -
publicly available vision instruction datasets (broad web data: may contain benchmark test sets) · split: unknown · fine-tuning
Evidence
“The instruction tuning data includes publicly available vision instruction datasets, as well as over 3M synthetically generated examples.”
raw.githubusercontent.com · model card · Training Data / Overview · retrieved 2026-10-15 -
over 3M synthetically generated examples (not yet matched to a dataset) · split: unknown · fine-tuning
Evidence
“The instruction tuning data includes publicly available vision instruction datasets, as well as over 3M synthetically generated examples.”
raw.githubusercontent.com · model card · Training Data / Overview · retrieved 2026-10-15 -
large-scale noisy (image, text) pair data (broad web data: may contain benchmark test sets) · split: unknown
Same as the existing '6B image and text pairs' entry, described as noisy web-scale pairs.
Evidence
“First, we add image adapters and encoders, then pretrain on large-scale noisy (image, text) pair data.”
ai.meta.com · website · Vision models · retrieved 2026-10-15 -
medium-scale high quality in-domain and knowledge-enhanced (image, text) pair data (not yet matched to a dataset) · split: unknown
Annealing stage (model card lists 'Stage 2 annealing').
Evidence
“Next, we train on medium-scale high quality in-domain and knowledge-enhanced (image, text) pair data.”
ai.meta.com · website · Vision models · retrieved 2026-10-15 -
synthetic QA generated with Llama 3.1 on in-domain images (not yet matched to a dataset) · split: unknown · fine-tuning
Evidence
“We leverage synthetic data generation by using the Llama 3.1 model to filter and augment question and answers on top of in-domain images”
ai.meta.com · website · Vision models · retrieved 2026-10-15 -
pre-trained image encoder (Llama 3 paper: ViT-H/14, MetaCLIP-style, 2.5B image-text pairs) (broad web data: may contain benchmark test sets) · split: unknown
The Llama 3 paper describes the 'Llama 3-V' research models (8B/70B/405B); Meta does not explicitly state that the released 11B/90B Llama 3.2-Vision encoder is the same. Encoder is not in the allowed base-model id list.
Evidence
“we trained a set of adapter weights that integrate the pre-trained image encoder into the pre-trained language model.”
ai.meta.com · website · Vision models · retrieved 2026-10-15 “which has 630M parameters that were trained on 2.5B image-text pairs for five epochs.”
arxiv.org · paper · Section 7.2 Image encoder · retrieved 2026-10-15 -
academic datasets converted to QA pairs (image SFT data, Llama 3 paper) (not yet matched to a dataset) · split: unknown · fine-tuning
Datasets not named; describes the Llama 3-V recipe in the Llama 3 paper, assumed (not stated) to match Llama 3.2-Vision. Overlaps the existing entry 'publicly available vision instruction datasets'.
Evidence
“We convert a highly filtered collection of existing academic datasets to questionanswer pairs using templates or via LLM rewriting.”
arxiv.org · paper · Section 7.5.1 Supervised Finetuning Data · retrieved 2026-10-15
Benchmark cells
Classic LLM benchmarks
Unknown MMLU (Measuring Massive Multitask Language Understanding) · training data not disclosed in enough detail
Unknown GSM8K (Grade School Math 8K) · training data not disclosed in enough detail
Unknown MATH (Mathematics Aptitude Test of Heuristics) · training data not disclosed in enough detail
Unknown HumanEval · training data not disclosed in enough detail
Unknown ARC-Challenge (AI2 Reasoning Challenge, Challenge Set) · training data not disclosed in enough detail
Unknown HellaSwag · training data not disclosed in enough detail
Unknown TruthfulQA · training data not disclosed in enough detail
Unknown WinoGrande · training data not disclosed in enough detail
Multimodal LLM benchmarks
Unknown MMMU (Massive Multi-discipline Multimodal Understanding and Reasoning) · training data not disclosed in enough detail
Unknown MMMU-Pro · training data not disclosed in enough detail
Unknown MathVista · training data not disclosed in enough detail
Unknown ChartQA · training data not disclosed in enough detail
Unknown DocVQA · training data not disclosed in enough detail
Unknown AI2D (AI2 Diagrams) · training data not disclosed in enough detail
Not seen CharXiv · its test items were published from 2024-06-26, after the model's stated training-data cutoff (2023-12-01)
Evidence (3)
“The pretraining data has a cutoff of December 2023”
“arXiv:2406.18521v1 [cs.CL] 26 Jun 2024”
“we release all QA pairs for the validation set and keep the answers to the test set private to prevent data leakage.”
Recent LLM benchmarks
Unknown GPQA Diamond · training data not disclosed in enough detail
Unknown MMLU-Pro · training data not disclosed in enough detail
Unknown LiveCodeBench (code generation, release_v6) · training data not disclosed in enough detail
Unknown SWE-bench Verified · training data not disclosed in enough detail
Not seen AIME 2024 · its test items were published from 2024-01-31, after the model's stated training-data cutoff (2023-12-01)
Evidence (4)
“The pretraining data has a cutoff of December 2023”
“2024 AIME I problems and solutions. The test was held on Wednesday, January 31 – Thursday, February 1, 2024.”
“AIME I (main AIME competition date): Thursday, Feb. 1, 2024 between 1:30 pm ET and 5:30 pm ET.”
“AIME II (alternate AIME competition date): Wednesday, Feb. 7, 2024 between 1:30 pm ET and 5:30 pm ET.”
Not seen AIME 2025 · its test items were published from 2025-02-06, after the model's stated training-data cutoff (2023-12-01)
Evidence (3)
“The pretraining data has a cutoff of December 2023”
“2025 AIME I problems and solutions. The test was held on Thursday, February 6, 2025.”
“This year the AIME I will take place on February 6, 2025, while the alternate AIME II will take place on February 12, 2025.”
Unknown MATH-500 · training data not disclosed in enough detail
Notes
Modality set to text because the language backbone is evaluated on text benchmarks; the model also takes images. Built on the Llama 3.1 text model, so the llama-3.1 contamination findings may apply to its language backbone (not stated by Meta). Accepts image input: “Llama 3.2-Vision models come with multimodal (text and image) input capabilities enabling image reasoning applications.” Accepts image input: “The Llama 3.2-Vision instruction-tuned models are optimized for visual recognition, image reasoning, captioning, and answering general questions about an image.”
Sources
- Llama 3.2-Vision MODEL_CARD_VISION.md (meta-llama/llama-models) · model card · retrieved 2026-10-15
- meta-llama/llama-models README (launch dates) · readme · retrieved 2026-10-15
- Meta AI blog: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models (2024-09-25) · website · retrieved 2026-10-15
- The Llama 3 Herd of Models (arXiv 2407.21783v3), Section 7 Vision Experiments · paper · retrieved 2026-10-15