Jurassic-1
AI21's first large language model, a GPT-3 era contemporary
Jurassic-1 is AI21 Labs’ first large language model family, announced in August 2021 alongside the launch of AI21 Studio. The largest version, Jurassic-1 Jumbo, has 178 billion parameters, putting it in the same size class as OpenAI’s GPT-3 and making it one of the largest publicly available language models at the time of release. AI21 built Jurassic-1 with a larger vocabulary than GPT-3, about 256,000 tokens compared to GPT-3’s roughly 50,000, using multi-word tokens to represent common phrases more efficiently and reduce the number of tokens needed to process a given piece of text. It was accessible only through AI21 Studio’s API rather than as open weights, and AI21 positioned it as a direct competitor to GPT-3 for tasks like text generation, summarization, and question answering. Jurassic-1 was AI21’s flagship model until the company replaced it with Jurassic-2 in 2023, and it has since been retired in favor of AI21’s newer Jamba model family.