A developer has created an open-source browser-based rhythm game called Struna that utilizes four small neural networks for audio analysis. These models, running locally via onnxruntime-web, process user-uploaded MP3 files to generate game elements. BeatNet tracks beats and bar lines, Spotify's Basic Pitch transcribes notes into gameplay features, Spleeter separates vocals, and SwiftF0 tracks vocal pitch and syllables to influence the game world and obstacles. The entire system, totaling around 22MB, is designed for in-browser execution and includes fallback DSP functionality if the models cannot run efficiently. AI
IMPACT Demonstrates novel applications of small, locally-run audio analysis models in interactive entertainment.
RANK_REASON This is a user-created application integrating existing AI models for a specific purpose, rather than a release from a frontier lab or a significant industry event.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
