Baichuan-13B
Baichuan's open-weight bilingual model, predating the Baichuan 2/3/4 generations
Baichuan-13B is a bilingual Chinese-English language model that Baichuan Intelligent Technology released in July 2023, expanding on the company’s earlier 7B model. It has 13 billion parameters and was trained on about 1.4 trillion tokens, which the company said was 40% more training data than Meta’s LLaMA-13B had used at the time. It came in both a base checkpoint for further fine-tuning and a Baichuan-13B-Chat variant aligned for dialogue, both distributed on Hugging Face and GitHub under a community license that permits commercial use for smaller companies. It predates the Baichuan 2, 3, and 4 model families and is largely superseded by them, but it was one of the earlier open-weight Chinese LLMs to reach 13B scale with a permissive-enough license for commercial experimentation.