Ollama

// about Ollama

Ollama makes it trivially easy to download and run open-source LLMs — Llama 3, Mistral, Gemma, Phi, Qwen, and dozens more — entirely on your own hardware with a single command. It exposes a local REST API compatible with the OpenAI format, so any application built for GPT can be pointed at a local model instead. Privacy-conscious developers, researchers without cloud budgets, and anyone wanting offline AI capability have made Ollama one of the fastest-growing tools in the AI ecosystem.