Falcon 7B
TII's compact Falcon tier that helped popularize the original Falcon release
Falcon 7B is the smaller sibling in TII’s original Falcon release, trained on the same RefinedWeb dataset as Falcon 40B but sized for cheaper deployment on a single GPU. TII trained it over about two weeks in early 2023 and released it under the permissive Apache 2.0 license, which let developers use, modify, and deploy it commercially without royalties. That licensing move was notable at the time, since many comparable open models carried research-only restrictions. Falcon 7B shares the 40B model’s decoder-only transformer architecture with multiquery attention, but with a 2,048 token context window and lower compute requirements, making it a common choice for fine-tuning experiments and on-device use cases in 2023 and early 2024. TII has since moved on to the Falcon 3 and Falcon Mamba families, leaving Falcon 7B as a legacy model still widely mirrored on Hugging Face.