Llama 3.1 8B

Meta's compact tier of the Llama 3.1 generation

Free Language
Visit Product Page →
128000 context tokens
8B parameters
Llama 3.1 Community License license
Jul 2024 released

Llama 3.1 8B is the small tier of the same July 2024 release, built for people who want to run a capable model on a single GPU or even a high-end laptop. It shares the 128,000-token context window and multilingual training of its larger siblings, and it scores higher than the original Llama 3 8B on MMLU and HumanEval thanks to more training data and refined post-training. Developers use it for on-device assistants, cheap batch processing, and fine-tuning experiments where the 70B or 405B models would be overkill or too expensive to serve. It runs easily through tools like Ollama and is one of the most downloaded models on Hugging Face.