VALL-E 2
Microsoft's improved zero-shot voice-cloning model reaching human parity on benchmarks
Paid
Audio Generation
Undisclosed
parameters
Proprietary
license
Jun 2024
released
// about VALL-E 2
Microsoft's improved zero-shot voice-cloning model reaching human parity on benchmarks
// similar models in Audio Generation
Whisper
OpenAI's open-weight speech recognition and transcription model
OpenAI · Audio Generation · Free
Eleven Multilingual v2
ElevenLabs' flagship text-to-speech model across 29 languages
ElevenLabs · Audio Generation · Freemium
Eleven v3
ElevenLabs' most expressive text-to-speech model with fine-grained emotional control
ElevenLabs · Audio Generation · Freemium
GPT-4o Realtime
Low-latency speech-to-speech variant of GPT-4o for live voice conversation
OpenAI · Audio Generation · Paid
MusicGen
Meta's open-weight controllable music generation model
Meta AI · Audio Generation · Free
Suno v4.5
Suno's flagship text-to-music generation model
Suno · Audio Generation · Freemium