VALL-E
Microsoft's neural codec voice-cloning model that mimics a speaker from a 3-second sample
Paid
Audio Generation
Undisclosed
parameters
Proprietary
license
Jan 2023
released
// about VALL-E
Microsoft's neural codec voice-cloning model that mimics a speaker from a 3-second sample
// similar models in Audio Generation
Whisper
OpenAI's open-weight speech recognition and transcription model
OpenAI · Audio Generation · Free
Eleven Multilingual v2
ElevenLabs' flagship text-to-speech model across 29 languages
ElevenLabs · Audio Generation · Freemium
Eleven v3
ElevenLabs' most expressive text-to-speech model with fine-grained emotional control
ElevenLabs · Audio Generation · Freemium
GPT-4o Realtime
Low-latency speech-to-speech variant of GPT-4o for live voice conversation
OpenAI · Audio Generation · Paid
MusicGen
Meta's open-weight controllable music generation model
Meta AI · Audio Generation · Free
Suno v4.5
Suno's flagship text-to-music generation model
Suno · Audio Generation · Freemium