TinyGiantALM: A Compact Audio-Language Model for Intent-Aware Reasoning under Resource Constraints
Researchers have developed TinyGiantALM, a new 1.5 billion parameter audio-language model designed for resource-constrained environments. This model utilizes an Instruction-Aware Feature Refinement framework, incorporating a Query-guided Projector and Semantic Gating, to better process acoustic signals based on user intent. On the MMAR benchmark, TinyGiantALM achieved 46.4% zero-shot accuracy, outperforming larger models up to 13 billion parameters and demonstrating a viable path for efficient edge-based perception. AI
IMPACT Demonstrates that architectural improvements can yield strong performance on edge devices, reducing the need for massive model scaling.