omni-modal large language models
PulseAugur coverage of omni-modal large language models — every cluster mentioning omni-modal large language models across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
New methods tackle OmniLLM token compression for efficiency
Two new research papers propose methods to compress token sequences in omnimodal large language models (OmniLLMs) to reduce inference costs. The first paper, DASH, uses audio cues to dynamically segment sequences and a …
-
AVOC framework boosts LLM long-form audio-video understanding
Researchers have developed AVOC, a novel framework designed to enhance the long-form audio-video understanding capabilities of Omni-modal Large Language Models. AVOC addresses limitations in context window size and info…
-
New Ex-Omni Model Integrates 3D Facial Animation with LLMs
Researchers have developed Ex-Omni, an open-source model designed to integrate 3D facial animation generation with omni-modal large language models (OLLMs). This model addresses the challenge of bridging LLMs' discrete …
-
SEATS method slashes LLM compute by pruning audio-visual tokens
Researchers have developed SEATS, a new method to make omni-modal large language models (om-LLMs) more efficient. SEATS prunes redundant audio-visual tokens throughout the model's layers, adapting the token selection pr…
-
New frameworks and benchmarks advance Video-LLM efficiency and understanding
Researchers have introduced EarlyTom, a novel framework designed to enhance the efficiency of video large language models (Video-LLMs) by compressing visual tokens early in the vision encoder. This approach significantl…