Researchers have introduced MuScriptor, an open-weight model designed for multi-instrument music transcription. Unlike previous models that struggled with complex mixes or single instruments, MuScriptor can transcribe notes from various instruments in diverse musical genres, including pop, classical, metal, and jazz, into MIDI format. The model was developed through a combination of synthetic data pre-training, fine-tuning on real audio, and reinforcement learning, with the added capability of conditioning on instrument presence. MuScriptor is available for use on its own website and as open-source code on GitHub. AI
IMPACT This model could significantly improve automated music transcription, enabling new tools for musicians and researchers working with complex audio.
RANK_REASON The cluster describes a new open-weight model release for a specific research task (music transcription) and includes a paper. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
