128000
context tokens
8B
parameters
Llama 3.1 Community License
license
Jul 2024
released
Llama 3.1 8B is the small tier of the same July 2024 release, built for people who want to run a capable model on a single GPU or even a high-end laptop. It shares the 128,000-token context window and multilingual training of its larger siblings, and it scores higher than the original Llama 3 8B on MMLU and HumanEval thanks to more training data and refined post-training. Developers use it for on-device assistants, cheap batch processing, and fine-tuning experiments where the 70B or 405B models would be overkill or too expensive to serve. It runs easily through tools like Ollama and is one of the most downloaded models on Hugging Face.