PulseAugur
EN
LIVE 13:58:26

Stereo2Spatial model converts stereo music to spatial audio

A new open-source model called Stereo2Spatial has been developed to convert stereo music into spatialized binaural mixes. The model utilizes a flow-matching diffusion approach, initially exploring latent space before pivoting to raw waveform modeling for improved quality. Training stability was achieved by implementing amplitude lifting techniques, inspired by the WavFlow paper, and the model was trained on over 7,000 tracks using dual A6000 GPUs. The project includes released code and a Windows desktop application for inference, all under an Apache 2.0 license. AI

IMPACT Enables creation of spatial audio from existing stereo music libraries, potentially enhancing immersive listening experiences.

RANK_REASON The cluster describes the release of a new open-source model and associated code for audio processing. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/MachineLearning →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Stereo2Spatial model converts stereo music to spatial audio

COVERAGE [1]

  1. r/MachineLearning TIER_1 English(EN) · /u/kittenkrazy ·

    Stereo2Spatial: Convert Stereo Music Tracks to Spatialized Binaural Mixes [P]

    <!-- SC_OFF --><div class="md"><p>I have released a model that I have been working on for ~6 months off and on. I've been enjoying listening to spatial music, but there is a lot of music out there with no real quality spatial mix. So I decided to make a model to convert stereo to…