Contamination Map Methodology

Text / LLM / Model

Mistral Medium 3.5

Organisation
Mistral AI
Family
Mistral · version 3.5
Released
2026-05-22 (Mistral AI blog 'Remote agents in Vibe. Powered by Mistral Medium 3.5.' dated May 22, 2026, which announces the open weights)
Training cutoff
2024-11-01
Evidence
“Your knowledge base was last updated on Friday, November 1, 2024.”
huggingface.co · code · SYSTEM_PROMPT.txt shipped with the weights · retrieved 2026-10-15
Checkpoints
mistralai/Mistral-Medium-3.5-128B
Weights
Open · Modified MIT License
Links
Model card

Training data disclosure: None

Level determined for 4% of benchmark cells.

Benchmark cells

Classic LLM benchmarks

Unknown MMLU (Measuring Massive Multitask Language Understanding) · training data not disclosed in enough detail

Unknown GSM8K (Grade School Math 8K) · training data not disclosed in enough detail

Unknown MATH (Mathematics Aptitude Test of Heuristics) · training data not disclosed in enough detail

Unknown HumanEval · training data not disclosed in enough detail

Unknown ARC-Challenge (AI2 Reasoning Challenge, Challenge Set) · training data not disclosed in enough detail

Unknown HellaSwag · training data not disclosed in enough detail

Unknown TruthfulQA · training data not disclosed in enough detail

Unknown WinoGrande · training data not disclosed in enough detail

Multimodal LLM benchmarks

Unknown MMMU (Massive Multi-discipline Multimodal Understanding and Reasoning) · training data not disclosed in enough detail

Unknown MMMU-Pro · training data not disclosed in enough detail

Unknown MathVista · training data not disclosed in enough detail

Unknown ChartQA · training data not disclosed in enough detail

Unknown DocVQA · training data not disclosed in enough detail

Unknown AI2D (AI2 Diagrams) · training data not disclosed in enough detail

Unknown CharXiv · training data not disclosed in enough detail

Recent LLM benchmarks

Unknown GPQA Diamond · training data not disclosed in enough detail

Unknown MMLU-Pro · training data not disclosed in enough detail

Unknown LiveCodeBench (code generation, release_v6) · training data not disclosed in enough detail

Unknown SWE-bench Verified · training data not disclosed in enough detail

Unknown AIME 2024 · training data not disclosed in enough detail

Not seen AIME 2025 · its test items were published from 2025-02-06, after the model's stated training-data cutoff (2024-11-01)

Evidence (3)
“Your knowledge base was last updated on Friday, November 1, 2024.”
huggingface.co · code · SYSTEM_PROMPT.txt shipped with the weights · retrieved 2026-10-15
“2025 AIME I problems and solutions. The test was held on Thursday, February 6, 2025.”
web.archive.org · website · retrieved 2026-10-15
“This year the AIME I will take place on February 6, 2025, while the alternate AIME II will take place on February 12, 2025.”
maa.org · website · retrieved 2026-10-15

Unknown MATH-500 · training data not disclosed in enough detail

Notes

Dense 128B; most recent general-purpose Mistral open-weight LLM found (HF repo created 2026-03-31, blog 2026-05-22). No training-data description. Cutoff comes only from the recommended system prompt. Accepts image input: “Accepts both text and image input, with text output.”

Sources