Mixtral 8x7B
Mistral's original open-weight mixture-of-experts model that popularised sparse MoE LLMs
Free
Language
32768
context tokens
46.7B
parameters
Apache 2.0
license
Dec 2023
released
// about Mixtral 8x7B
Mistral's original open-weight mixture-of-experts model that popularised sparse MoE LLMs