Text / LLM / Model

K2-Horizon

Organisation
MBZUAI Institute of Foundation Models (IFM) / LLM360
Family
LLM360 K2 · version 0.9B, 3.7B, 7B, 32B, MoVA-36B-A4B, 375B-A23B
Released
2026-09-01 (HF createdAt of IFM/K2-Horizon-* repos, 2026-09-01 (e.g. https://huggingface.co/api/models/IFM/K2-Horizon-32B))
Checkpoints
IFM/K2-Horizon-0.9B, IFM/K2-Horizon-3.7B, IFM/K2-Horizon-7B, IFM/K2-Horizon-32B, IFM/K2-Horizon-MoVA-36B-A4B, IFM/K2-Horizon-375B-A23B
Weights
Open · apache-2.0
Links

Training data disclosure: Partial list

Level determined for 0% of benchmark cells.

“Fully open.** Training data/recipe and the training code are public.”
huggingface.co · model card · Highlights · retrieved 2026-10-15
“Technical report | Not yet available | In Progress | End of September 2026”
huggingface.co · model card · Release Artifacts · retrieved 2026-10-15
“Data | [Hugging Face](https://huggingface.co/datasets/IFM/TxT360-v2) | Available”
huggingface.co · model card · Release Artifacts · retrieved 2026-10-15

Other declared training data

Benchmark cells

Classic LLM benchmarks

Unknown MMLU (Measuring Massive Multitask Language Understanding) · training data not disclosed in enough detail

Unknown GSM8K (Grade School Math 8K) · training data not disclosed in enough detail

Unknown MATH (Mathematics Aptitude Test of Heuristics) · training data not disclosed in enough detail

Unknown HumanEval · training data not disclosed in enough detail

Unknown ARC-Challenge (AI2 Reasoning Challenge, Challenge Set) · training data not disclosed in enough detail

Unknown HellaSwag · training data not disclosed in enough detail

Unknown TruthfulQA · training data not disclosed in enough detail

Unknown WinoGrande · training data not disclosed in enough detail

Recent LLM benchmarks

Unknown GPQA Diamond · training data not disclosed in enough detail

Unknown MMLU-Pro · training data not disclosed in enough detail

Unknown LiveCodeBench (code generation, release_v6) · training data not disclosed in enough detail

Unknown SWE-bench Verified · training data not disclosed in enough detail

Unknown AIME 2024 · training data not disclosed in enough detail

Unknown AIME 2025 · training data not disclosed in enough detail

Unknown MATH-500 · training data not disclosed in enough detail

Notes

One entry for the family: all six cards point to the same data release (IFM/TxT360-v2 and the K2 Horizon dataset series), but per-size recipes differ: 3.7B/7B/32B/MoVA cards list 22.9T pre-training tokens, 375B-A23B lists two phases (7.08T + 8.05T), 0.9B lists 5T plus multi-teacher distillation; post-training differs (SFT only for 32B and MoVA; RL experts + merge + SFT for 3.7B/7B/375B; RL + on-policy distillation for 0.9B). No technical report yet (cards dated 2026-09-28 say end of September 2026). The ifm.ai blog returned HTTP 403 to automated fetches, so nothing is quoted from it.

Sources