OLMoE

AI2's fully open mixture-of-experts model

Free Language
Visit Product Page →
4096 context tokens
7B (1B active) parameters
Apache 2.0 license
Sep 2024 released

// about OLMoE

AI2's fully open mixture-of-experts model