Infinite Music Glitch on my Arduino with Magenta Realtime 2
A developer has created a real-time music generation system using an ESP32 microcontroller and a MacBook Pro. The setup transcribes user speech with MLX Whisper, then uses a Qwen model to determine tool calls for music manipulation. These calls can alter the music by adding drums, changing its style to Lo-fi or Jazz, or removing instruments, with the generated audio streamed back to the microcontroller. AI
IMPACT Enables real-time, agentic music generation and manipulation through a DIY hardware-software setup.