BLIP

Salesforce's vision-language pretraining model for captioning and retrieval

Free Multimodal
Visit Product Page →
223M parameters
BSD-3-Clause license
Jan 2022 released

BLIP (Bootstrapping Language-Image Pre-training) is a vision-language model that Salesforce Research introduced in early 2022. It handles both understanding tasks, like image captioning and visual question answering, and retrieval tasks, like matching images to text. The model was trained with a bootstrapping method that cleans up noisy web-scraped captions by generating synthetic ones and filtering out the bad matches, which let it reach strong results without relying purely on massive uncurated datasets. At around 223 million parameters, BLIP is small next to later multimodal systems, but it was influential in showing that caption quality matters as much as caption quantity for pretraining.

Salesforce released BLIP’s weights and code openly under a BSD license, and it became a common baseline in vision-language research and a building block in other projects, including early versions of tools like Stable Diffusion’s interrogator features. Its successor, BLIP-2, improved efficiency by pairing frozen image encoders with frozen language models through a lightweight bridging module, but the original BLIP is still used in academic work and self-hosted pipelines where a compact, well-documented captioning model is enough.