Falcon 3

TII's efficient small-model open-weight family

Free Language
Visit Product Page →
32000 context tokens
10B parameters
Falcon License license
Dec 2024 released

Falcon 3 is a family of open-weight language models from the Technology Innovation Institute in Abu Dhabi, released in December 2024 in four sizes: 1B, 3B, 7B, and 10B parameters, each with base and instruct versions. TII built the line to run on modest hardware, including a single GPU or a laptop, while still competing with larger open models. The 10B model topped Hugging Face’s leaderboard for models under 13B parameters at launch, scoring 73.1 on MMLU and 83.1 on GSM8K, ahead of comparable Llama and Gemma variants at the time. Most sizes support a 32K token context window (the 1B model is limited to 8K), and TII distributes the weights on Hugging Face under its own Falcon License for self-hosted use. Falcon 3 followed the earlier Falcon and Falcon Mamba releases and reflects TII’s shift toward smaller, cheaper-to-run models rather than chasing frontier parameter counts.