Self-Hosted on Best of AI

Arctic

Thu, 16 Jul 2026 00:00:00 +0000

Arctic is a large language model that Snowflake released in April 2024, built for enterprise work like SQL generation, coding, and instruction following rather than general chat. It uses a mixture-of-experts design with 480 billion total parameters spread across 128 experts, but only about 17 billion are active for any given token, which keeps inference costs down relative to dense models of similar scale. Snowflake released both the base and instruct checkpoints under an Apache 2.0 license, so the weights can be self-hosted or run through Snowflake Cortex. On the Spider text-to-SQL benchmark it scored around 79% accuracy, and Snowflake pitched it as a way to bring capable open models into data warehouses without sending queries to a third-party API. It trades off a shorter 4K context window and weaker general chat ability against strong performance on the narrow enterprise tasks it was built for.

Baichuan 2

Thu, 16 Jul 2026 00:00:00 +0000

Baichuan 2 is the second generation of open-weight language models from Baichuan Intelligent Technology, released in September 2023. It came in 7B and 13B parameter sizes, each with base and chat variants, and was trained on 2.6 trillion bilingual Chinese-English tokens, roughly double what the original Baichuan models saw. Baichuan reported that the 7B model gained close to 30% on MMLU over its Baichuan 1 predecessor of the same size, and the family did well on Chinese-language benchmarks like C-Eval and CMMLU relative to other open models available at the time. The weights are distributed under Apache 2.0 for the code plus a separate community license for the model itself, which allows free commercial use as long as the deploying company has under 1 million daily active users and isn’t itself a cloud or software service reselling the model. It has since been superseded by Baichuan 3 and Baichuan 4, which moved to closed, API-only access.

Cerebras-GPT

Thu, 16 Jul 2026 00:00:00 +0000

Cerebras-GPT is a family of language models, ranging from 111 million to 13 billion parameters, that Cerebras trained on its own CS-2 wafer-scale systems and released in March 2023. The point of the project was less about beating benchmarks and more about openness: Cerebras published the weights, training code, and a detailed technical report describing hyperparameters and scaling behavior for every size in the family, following compute-optimal training recipes similar to those behind Chinchilla. That made Cerebras-GPT one of the more fully documented open model families of its time, useful to researchers who wanted a clean, reproducible baseline for studying scaling laws.

ChatGLM3

Thu, 16 Jul 2026 00:00:00 +0000

ChatGLM3 is the third generation of the ChatGLM dialogue model line, built jointly by Zhipu AI and Tsinghua University’s KEG lab and released in late October 2023. The base ChatGLM3-6B model uses a bilingual Chinese-English design and added stronger support for function calling, code execution, and agent-style tool use compared to its predecessors, along with a more diverse pretraining mix covering more training tokens and better alignment training. At release, Zhipu reported that the 6B base model led other pretrained models under 10 billion parameters across dozens of benchmarks spanning reasoning, math, code, and general knowledge.

CLIP (LAION variant)

Thu, 16 Jul 2026 00:00:00 +0000

This CLIP variant is an open-weight retraining of OpenAI’s original CLIP architecture, produced by LAION and distributed through the open_clip project rather than by OpenAI itself. It uses the ViT-L/14 vision transformer backbone, has about 428 million parameters, and was trained on LAION-2B, the English-language 2 billion image-text pair subset of the larger LAION-5B dataset, using 384 A100 GPUs on the JUWELS supercomputer. Like the original CLIP, it maps images and text into a shared embedding space so you can do zero-shot image classification, image-text retrieval, and similarity search without any task-specific fine-tuning, and it reaches about 75.3 percent zero-shot accuracy on ImageNet-1k. Because the weights are released under an open license and hosted on Hugging Face, it has become a common drop-in replacement for OpenAI’s closed CLIP checkpoints in open-source image search, captioning, and generative art pipelines, including as a text encoder inside several Stable Diffusion variants.

Code Llama

Thu, 16 Jul 2026 00:00:00 +0000

Code Llama is Meta’s code-focused version of Llama 2, released in August 2023. It was trained further on code-heavy data on top of the base Llama 2 weights and shipped in three foundation sizes (7B, 13B, and 34B parameters), each with a base version, a Python-specialized version, and an instruction-tuned version for chat-style coding help. Meta later added a 70B variant. A key change from the base Llama 2 model was extending the context window from 4,096 tokens up to 100,000 tokens, achieved by adjusting the RoPE positional embeddings, which made the model far more useful for reading and editing long files or entire codebases in one pass.

CodeT5+

Thu, 16 Jul 2026 00:00:00 +0000

CodeT5+ is a family of open-weight code models built by Salesforce Research, released in May 2023 as a follow-up to the original CodeT5 encoder-decoder model. It comes in several sizes from 220 million up to 16 billion parameters and can run in encoder-only, decoder-only, or full encoder-decoder mode, which lets one architecture cover code understanding tasks like defect detection alongside generation tasks like code completion and text-to-code synthesis. Training combines span denoising, causal language modeling, contrastive learning, and text-code matching objectives, an approach Salesforce says gives it an edge over decoder-only code models of similar size on retrieval-augmented generation tasks. The 16B variant scores around 30.9% pass@1 on HumanEval, and an instruction-tuned version of the same checkpoint pushes past 35%, beating OpenAI’s older code-cushman-001 model on the same benchmark. Weights are hosted on Hugging Face under a BSD-3-Clause license, making CodeT5+ one of the earlier fully open alternatives to Codex-era proprietary code models.

DBRX

Thu, 16 Jul 2026 00:00:00 +0000

DBRX is Databricks’ open-weight large language model, released in March 2024 as the base model behind the instruction-tuned DBRX Instruct. It is a fine-grained mixture-of-experts model with 132 billion total parameters and 36 billion active parameters per token, trained from scratch on 12 trillion tokens of text and code using Databricks’ own Mosaic AI training stack. At release, Databricks reported it outperforming other open models of the time, including Llama 2 70B and Mixtral, on benchmarks such as MMLU and HumanEval, and it was pitched as evidence that an enterprise-focused company could train a competitive foundation model without relying on a big-lab research budget. It has a 32,000-token context window and is released under the Databricks Open Model License, with weights available on Hugging Face for self-hosting or through Databricks’ own serving infrastructure.

DBRX Instruct

Thu, 16 Jul 2026 00:00:00 +0000

DBRX Instruct is the fine-tuned, chat-ready version of Databricks’ DBRX model, released in March 2024 alongside the DBRX base model. It uses a fine-grained mixture-of-experts architecture with 132 billion total parameters, of which only 36 billion are active for any given token, and it was trained on 12 trillion tokens of text and code. Databricks tuned it specifically for instruction following and multi-turn conversation, and at launch the company reported it beating GPT-3.5 on MMLU (73.7% versus 70.0%) and on HumanEval (70.1% versus 48.1%). It supports a 32,000-token context window and is distributed under the Databricks Open Model License, which permits commercial use with some restrictions for very large deployments. Organizations run it through Databricks’ own platform or self-host the weights from Hugging Face.

DeepSeek Coder V2

Thu, 16 Jul 2026 00:00:00 +0000

DeepSeek-Coder-V2 is DeepSeek’s second-generation code model, released in June 2024 as a mixture-of-experts model with 236 billion total parameters and 21 billion active per token. It extended the context window to 128,000 tokens, up sharply from the 16,000-token window of the original DeepSeek-Coder, and expanded language coverage from 86 to 338 programming languages. On HumanEval it scored 90.2%, a result DeepSeek billed at the time as closing the gap with closed models like GPT-4 Turbo on coding tasks, and it also improved on general reasoning and math benchmarks compared to its predecessor. Unlike the original DeepSeek-Coder’s more restrictive license, DeepSeek-Coder-V2 is released under the MIT license, making it freely usable for commercial projects, and weights are available on Hugging Face alongside API access through DeepSeek’s own platform.

DeepSeek LLM 67B

Thu, 16 Jul 2026 00:00:00 +0000

DeepSeek LLM 67B is DeepSeek’s first dense foundation model, released in November 2023 before the company pivoted toward the mixture-of-experts architectures used in its later V2 and V3 lines. It is a 67-billion-parameter dense transformer trained on 2 trillion tokens of English and Chinese text, and it scored around 71.9 on MMLU, putting it roughly in line with Llama 2 70B on general knowledge benchmarks while beating it on several Chinese-language tasks. The model has a comparatively short 4,096-token context window by later standards, reflecting the norms of late 2023 training runs. It was released with both base and chat variants under a permissive DeepSeek license allowing commercial use, and it served as the foundation DeepSeek built on for its subsequent, more widely used models.

DeepSeek V3

Thu, 16 Jul 2026 00:00:00 +0000

EXAONE 3.5

Thu, 16 Jul 2026 00:00:00 +0000

Falcon 180B

Thu, 16 Jul 2026 00:00:00 +0000

Falcon 3

Thu, 16 Jul 2026 00:00:00 +0000

Falcon 40B

Thu, 16 Jul 2026 00:00:00 +0000

Falcon Mamba 7B

Thu, 16 Jul 2026 00:00:00 +0000

Gemma 2

Thu, 16 Jul 2026 00:00:00 +0000

Gemma 3

Thu, 16 Jul 2026 00:00:00 +0000

GLM-4

Thu, 16 Jul 2026 00:00:00 +0000

GLM-4.6

Thu, 16 Jul 2026 00:00:00 +0000

GLM-5.2

Thu, 16 Jul 2026 00:00:00 +0000

GPT-J

Thu, 16 Jul 2026 00:00:00 +0000

GPT-NeoX-20B

Thu, 16 Jul 2026 00:00:00 +0000

Granite 3.0

Thu, 16 Jul 2026 00:00:00 +0000

Granite Code

Thu, 16 Jul 2026 00:00:00 +0000

Hermes 2

Thu, 16 Jul 2026 00:00:00 +0000

Hermes 3

Thu, 16 Jul 2026 00:00:00 +0000

Kimi K2

Thu, 16 Jul 2026 00:00:00 +0000

LLaMA

Thu, 16 Jul 2026 00:00:00 +0000

Llama 2

Thu, 16 Jul 2026 00:00:00 +0000

Llama 3

Thu, 16 Jul 2026 00:00:00 +0000

Llama 3.1 405B

Thu, 16 Jul 2026 00:00:00 +0000

Llama 3.1 8B

Thu, 16 Jul 2026 00:00:00 +0000

Llama 3.2

Thu, 16 Jul 2026 00:00:00 +0000

Llama 3.3

Thu, 16 Jul 2026 00:00:00 +0000

Llama 4 Maverick

Thu, 16 Jul 2026 00:00:00 +0000

Llama 4 Scout

Thu, 16 Jul 2026 00:00:00 +0000

Llama Guard 3

Thu, 16 Jul 2026 00:00:00 +0000

Mistral 7B

Thu, 16 Jul 2026 00:00:00 +0000

Mistral NeMo

Thu, 16 Jul 2026 00:00:00 +0000

Mistral Small 3

Thu, 16 Jul 2026 00:00:00 +0000

Mixtral 8x22B

Thu, 16 Jul 2026 00:00:00 +0000

MPT-30B

Thu, 16 Jul 2026 00:00:00 +0000

Nemotron-4 340B

Thu, 16 Jul 2026 00:00:00 +0000

OLMo 2

Thu, 16 Jul 2026 00:00:00 +0000

OPT-175B

Thu, 16 Jul 2026 00:00:00 +0000

Pharia-1

Thu, 16 Jul 2026 00:00:00 +0000

Phi-2

Thu, 16 Jul 2026 00:00:00 +0000

Phi-3

Thu, 16 Jul 2026 00:00:00 +0000

Phi-3.5-mini

Thu, 16 Jul 2026 00:00:00 +0000

Pythia

Thu, 16 Jul 2026 00:00:00 +0000

Qwen1.5-110B

Thu, 16 Jul 2026 00:00:00 +0000

Qwen2-72B

Thu, 16 Jul 2026 00:00:00 +0000

Qwen2.5-72B

Thu, 16 Jul 2026 00:00:00 +0000

Qwen3-235B-A22B

Thu, 16 Jul 2026 00:00:00 +0000

QwQ-32B

Thu, 16 Jul 2026 00:00:00 +0000

RedPajama-INCITE

Thu, 16 Jul 2026 00:00:00 +0000

replit-code-v1.5

Thu, 16 Jul 2026 00:00:00 +0000

Solar Pro 2

Thu, 16 Jul 2026 00:00:00 +0000

StableLM 2

Thu, 16 Jul 2026 00:00:00 +0000

StarCoder2

Thu, 16 Jul 2026 00:00:00 +0000

XGen-7B

Thu, 16 Jul 2026 00:00:00 +0000

Yi-1.5-34B

Thu, 16 Jul 2026 00:00:00 +0000

Yi-34B

Thu, 16 Jul 2026 00:00:00 +0000

Yi-Coder

Thu, 16 Jul 2026 00:00:00 +0000

Zephyr 7B

Thu, 16 Jul 2026 00:00:00 +0000