Mixtral 8x7B

Mistral's original open-weight mixture-of-experts model that popularised sparse MoE LLMs

Free Language
Visit Product Page →
32768 context tokens
46.7B parameters
Apache 2.0 license
Dec 2023 released

// about Mixtral 8x7B

Mistral's original open-weight mixture-of-experts model that popularised sparse MoE LLMs