DeepSeek-VL2
DeepSeek's open-weight vision-language mixture-of-experts model
DeepSeek-VL2 is a family of vision-language models that DeepSeek released on December 13, 2024, following up on the original DeepSeek-VL from earlier that year. It comes in three sizes, Tiny, Small, and the full VL2, with 3B, 16B, and 27B total parameters and 1B, 2.8B, and 4.5B active parameters respectively, using the same DeepSeekMoE and Multi-head Latent Attention architecture that powers DeepSeek’s language models. A dynamic tiling method lets it process high-resolution images of varying aspect ratios without losing detail, which helps on tasks like reading dense documents, charts, and screenshots.
The mixture-of-experts design means DeepSeek-VL2 gets strong performance on visual question answering, OCR, and visual grounding benchmarks while keeping inference cheap relative to its total parameter count, since only a small fraction of experts activate for any given input. All three sizes were released with open weights, making DeepSeek-VL2 one of the more capable open multimodal model families available at the time.