PulseAugur
EN
LIVE 05:55:15

New AI models and datasets advance multi-instrument music transcription

By PulseAugur Editorial · [6 sources] ·

Researchers have introduced MuScriptor, an open-weight model designed for multi-instrument music transcription from real-world audio. The model improves upon existing methods by analyzing synthetic data pre-training, fine-tuning on actual music, and employing reinforcement learning for post-training. Additionally, a new dataset called MulTTiPop has been released, featuring pop music segments and their multitrack MIDI recordings to aid in the evaluation of automatic music transcription models. AI

IMPACT These advancements in multi-instrument music transcription could enable more sophisticated music analysis tools and creative applications.

RANK_REASON Two arXiv papers introducing a new model and a new dataset for music transcription.

Read on arXiv cs.LG →

AI-generated summary · Google Gemini · from 6 sources. How we write summaries →

New AI models and datasets advance multi-instrument music transcription

COVERAGE [6]

  1. arXiv cs.LG TIER_1 Română(RO) · Simon Rouard, Michael Krause, Axel Roebel, Carl-Johann Simon-Gabriel, Alexandre D\'efossez ·

    MuScriptor: An Open Model for Multi-Instrument Music Transcription

    arXiv:2607.08168v1 Announce Type: cross Abstract: Existing methods for automatic music transcription are often limited to single-instrument recordings or fail on complex, real music mixes. Although previous work utilizes synthetic training data, the resulting models generalize po…

  2. arXiv cs.LG TIER_1 English(EN) · Nathan Pruyne, Benjamin Stoler, William Chen, Chien-yu Huang, Shinji Watanabe, Chris Donahue ·

    MulTTiPop: A Multitrack Transcription Dataset for Pop Music

    arXiv:2607.08756v1 Announce Type: cross Abstract: We present MulTTiPop, a dataset of pop music segments and their associated multitrack MIDI recordings for the evaluation of automatic music transcription models. MulTTiPop contains 572 segments of popular music totaling 3.5 hours …

  3. arXiv cs.LG TIER_1 English(EN) · Chris Donahue ·

    MulTTiPop: A Multitrack Transcription Dataset for Pop Music

    We present MulTTiPop, a dataset of pop music segments and their associated multitrack MIDI recordings for the evaluation of automatic music transcription models. MulTTiPop contains 572 segments of popular music totaling 3.5 hours of audio, and contains songs from diverse genres a…

  4. Hugging Face Daily Papers TIER_1 English(EN) ·

    MulTTiPop: A Multitrack Transcription Dataset for Pop Music

    We present MulTTiPop, a dataset of pop music segments and their associated multitrack MIDI recordings for the evaluation of automatic music transcription models. MulTTiPop contains 572 segments of popular music totaling 3.5 hours of audio, and contains songs from diverse genres a…

  5. arXiv cs.LG TIER_1 Română(RO) · Alexandre Défossez ·

    MuScriptor: An Open Model for Multi-Instrument Music Transcription

    Existing methods for automatic music transcription are often limited to single-instrument recordings or fail on complex, real music mixes. Although previous work utilizes synthetic training data, the resulting models generalize poorly, leading to largely unusable transcription ou…

  6. MarkTechPost TIER_1 English(EN) · Asif Razzaq ·

    Kyutai Releases MuScriptor: An Open-Weight Decoder-Only Transformer for Multi-Instrument Music Transcription to MIDI

    <p>MuScriptor is an open-weight, decoder-only Transformer from Kyutai and Mirelo. Trained on 170k real recordings plus 1.45M synthetic MIDIs, it transcribes full multi-instrument mixes into MIDI. The article covers its three-stage pipeline, benchmarks against YourMT3+, instrument…

RELATED ENTITIES

RELATED TOPICS