Whisper-GPT

Whisper-GPT model merges continuous and discrete audio for generation

Researchers have developed Whisper-GPT, a novel language model designed for generating speech and music. This model uniquely integrates continuous audio representations, like spectrograms, with discrete tokens derived f…