CosyVoice
Alibaba's open-weight zero-shot voice-cloning and text-to-speech model
CosyVoice is a text-to-speech and voice-cloning model from Alibaba’s FunAudioLLM team, released as open weights in July 2024. It generates speech from short reference audio clips, so it can clone a voice from just a few seconds of sample and then speak arbitrary text in that voice across multiple languages, including Chinese, English, Japanese, and Korean. The model builds on supervised semantic speech tokens paired with a language-model-style generation approach, which lets it handle cross-lingual and zero-shot voice cloning without speaker-specific fine-tuning. Alibaba has continued to update the line, later releasing CosyVoice 2 and CosyVoice 3 with larger underlying models and lower latency, and the original release remains available on Hugging Face and through Alibaba Cloud’s Model Studio API under an Apache 2.0 license.