Vision / Model
Anomaly-OneVision (Anomaly-OV)
- Organisation
- Johns Hopkins University / Honda Research Institute USA
- Family
- Anomaly-OV
- Released
- 2025-02-11 (arXiv v1 submission date (https://arxiv.org/abs/2502.07601))
- Checkpoints
- Anomaly-OV-0.5B, Anomaly-OV-7B
- Weights
- Unknown
- Links
- PaperCode
Training data disclosure: Partial list
Level determined for 25% of benchmark cells.
- TestTest data seen0
- SeenSeen, split unclear2
- TrainTraining data seen0
- Related data seen0
- NoNot seen0
- ?Unknown6
“For a unified visual inspection dataset, precise instruction data is collected from MVTec AD [2], the training set of BMAD [1], Anomaly-ShapeNet [50], Real3D-AD [60], and MVTec-3D AD [4]”
“This stage utilizes all of the data with anomaly labels in Anomaly-Instruct-125k. Similar to previous works [6, 110], when evaluating the model on the datasets contained in the training set, the corresponding datasets are replaced by VisA [115].”
Built on
Everything these base models may have seen is inherited by Anomaly-OneVision (Anomaly-OV).
-
LLaVA-OneVision
· disclosure: Partial list
Evidence
“We choose LLaVA-OneVision [44] as our base MLLM because it is open-sourced and performs similarly to other commercial models.”
arxiv.org · paper · Section 3 · retrieved 2026-10-15
Other declared training data
-
MVTec AD · split: unknown · fine-tuning
Split not stated. For evaluation on MVTec AD, the anomaly expert is trained with MVTec AD replaced by VisA.
Evidence
“For a unified visual inspection dataset, precise instruction data is collected from MVTec AD [2], the training set of BMAD [1], Anomaly-ShapeNet [50], Real3D-AD [60], and MVTec-3D AD [4]”
arxiv.org · paper · Section 4.1 · retrieved 2026-10-15 “This stage utilizes all of the data with anomaly labels in Anomaly-Instruct-125k. Similar to previous works [6, 110], when evaluating the model on the datasets contained in the training set, the corresponding datasets are replaced by VisA [115].”
arxiv.org · paper · Section 4.3 / training · retrieved 2026-10-15 -
VisA · split: unknown · fine-tuning
Split not stated. VisA-D&R, the authors' reasoning benchmark, is also built from VisA images.
Evidence
“This stage utilizes all of the data with anomaly labels in Anomaly-Instruct-125k. Similar to previous works [6, 110], when evaluating the model on the datasets contained in the training set, the corresponding datasets are replaced by VisA [115].”
arxiv.org · paper · Section 4.3 / training · retrieved 2026-10-15 -
BMAD (training set) · split: train · fine-tuning
Evidence
“For a unified visual inspection dataset, precise instruction data is collected from MVTec AD [2], the training set of BMAD [1], Anomaly-ShapeNet [50], Real3D-AD [60], and MVTec-3D AD [4]”
arxiv.org · paper · Section 4.1 · retrieved 2026-10-15 -
Anomaly-ShapeNet · split: unknown · fine-tuning
Evidence
“For a unified visual inspection dataset, precise instruction data is collected from MVTec AD [2], the training set of BMAD [1], Anomaly-ShapeNet [50], Real3D-AD [60], and MVTec-3D AD [4]”
arxiv.org · paper · Section 4.1 · retrieved 2026-10-15 -
Real3D-AD · split: unknown · fine-tuning
Evidence
“For a unified visual inspection dataset, precise instruction data is collected from MVTec AD [2], the training set of BMAD [1], Anomaly-ShapeNet [50], Real3D-AD [60], and MVTec-3D AD [4]”
arxiv.org · paper · Section 4.1 · retrieved 2026-10-15 -
MVTec-3D AD · split: unknown · fine-tuning
Evidence
“For a unified visual inspection dataset, precise instruction data is collected from MVTec AD [2], the training set of BMAD [1], Anomaly-ShapeNet [50], Real3D-AD [60], and MVTec-3D AD [4]”
arxiv.org · paper · Section 4.1 · retrieved 2026-10-15 -
WebAD (72k in-the-wild images collected via GPT-4o and Google Image Search) (broad web data: may contain benchmark test sets) · split: unknown · fine-tuning
Web-scraped images; could include public AD benchmark images. Treated as open-ended.
Evidence
“images (named as WebAD) targeting anomaly detection are collected, significantly enriching our instruction dataset.”
arxiv.org · paper · Section 4.1 · retrieved 2026-10-15 -
LLaVA-OneVision training recipe (about 350k samples) (not yet matched to a dataset) · split: unknown · fine-tuning
Evidence
“In addition to our instruction dataset, we sample around 350k data from the original training recipe of LLaVAOneVision to maintain the generalization ability.”
arxiv.org · paper · Section 4.3 · retrieved 2026-10-15
Benchmark cells
Industrial anomaly detection
Seen, split unclear MVTec AD · in fine-tuning data: the dataset was used; the source does not say which part
Evidence (2)
“For a unified visual inspection dataset, precise instruction data is collected from MVTec AD [2], the training set of BMAD [1], Anomaly-ShapeNet [50], Real3D-AD [60], and MVTec-3D AD [4]”
“This stage utilizes all of the data with anomaly labels in Anomaly-Instruct-125k. Similar to previous works [6, 110], when evaluating the model on the datasets contained in the training set, the corresponding datasets are replaced by VisA [115].”
Unknown MVTec AD 2 · unknown for its base model LLaVA-OneVision: training data not disclosed in enough detail
Unknown MVTec LOCO AD · unknown for its base model LLaVA-OneVision: unknown for its base model SigLIP: training data not disclosed in enough detail
Seen, split unclear VisA · in fine-tuning data: the dataset was used; the source does not say which part
Evidence (1)
“This stage utilizes all of the data with anomaly labels in Anomaly-Instruct-125k. Similar to previous works [6, 110], when evaluating the model on the datasets contained in the training set, the corresponding datasets are replaced by VisA [115].”
Unknown Real-IAD · unknown for its base model LLaVA-OneVision: training data not disclosed in enough detail
Unknown MPDD · unknown for its base model LLaVA-OneVision: unknown for its base model SigLIP: training data not disclosed in enough detail
Unknown BTAD · unknown for its base model LLaVA-OneVision: unknown for its base model SigLIP: training data not disclosed in enough detail
Unknown KolektorSDD2 · unknown for its base model LLaVA-OneVision: unknown for its base model SigLIP: training data not disclosed in enough detail
Notes
MLLM specialist (anomaly expert + LLaVA-OneVision). Zero-shot detection evaluated on MVTec AD, VisA, AITEX, ELPV, BTAD, MPDD, BrainMRI, HeadCT, Br35H. README releases code and the instruction dataset/benchmark (via project page) with training scripts; released weights not confirmed. WebAD (scraped web images) is marked open_ended.
Sources
- Towards Zero-Shot Anomaly Detection and Reasoning with Multimodal Large Language Models (CVPR 2025) · paper · retrieved 2026-10-15
- Anomaly-OneVision README · readme · retrieved 2026-10-15