Contamination Map Methodology

Text / LLM / Model

Mistral Large 3

Organisation
Mistral AI
Family
Mistral · version 2512
Released
2025-12-02 (Mistral AI blog 'Introducing Mistral 3' dated December 2, 2025 (https://mistral.ai/news/mistral-3))
Checkpoints
mistralai/Mistral-Large-3-675B-Base-2512, mistralai/Mistral-Large-3-675B-Instruct-2512, mistralai/Mistral-Large-3-675B-Instruct-2512-BF16, mistralai/Mistral-Large-3-675B-Instruct-2512-NVFP4
Weights
Open · Apache 2.0
Links
Model card

Training data disclosure: None

Level determined for 0% of benchmark cells.

Benchmark cells

Classic LLM benchmarks

Unknown MMLU (Measuring Massive Multitask Language Understanding) · training data not disclosed in enough detail

Unknown GSM8K (Grade School Math 8K) · training data not disclosed in enough detail

Unknown MATH (Mathematics Aptitude Test of Heuristics) · training data not disclosed in enough detail

Unknown HumanEval · training data not disclosed in enough detail

Unknown ARC-Challenge (AI2 Reasoning Challenge, Challenge Set) · training data not disclosed in enough detail

Unknown HellaSwag · training data not disclosed in enough detail

Unknown TruthfulQA · training data not disclosed in enough detail

Unknown WinoGrande · training data not disclosed in enough detail

Multimodal LLM benchmarks

Unknown MMMU (Massive Multi-discipline Multimodal Understanding and Reasoning) · training data not disclosed in enough detail

Unknown MMMU-Pro · training data not disclosed in enough detail

Unknown MathVista · training data not disclosed in enough detail

Unknown ChartQA · training data not disclosed in enough detail

Unknown DocVQA · training data not disclosed in enough detail

Unknown AI2D (AI2 Diagrams) · training data not disclosed in enough detail

Unknown CharXiv · training data not disclosed in enough detail

Recent LLM benchmarks

Unknown GPQA Diamond · training data not disclosed in enough detail

Unknown MMLU-Pro · training data not disclosed in enough detail

Unknown LiveCodeBench (code generation, release_v6) · training data not disclosed in enough detail

Unknown SWE-bench Verified · training data not disclosed in enough detail

Unknown AIME 2024 · training data not disclosed in enough detail

Unknown AIME 2025 · training data not disclosed in enough detail

Unknown MATH-500 · training data not disclosed in enough detail

Notes

Model cards and blog give no training-data description. The shipped SYSTEM_PROMPT.txt says 'Your knowledge base was last updated on 2023-10-01.', which is the same text as in older Mistral prompts and implausible for a December 2025 model, so it is not recorded as training_cutoff. Accepts image input: “Enables the model to analyze images and provide insights based on visual content, in addition to text.” Accepts image input: “A 2.5B Vision Encoder”

Sources