Multimodal Large Language Models and Tunings: Vision, Language, Sensors, Audio, and Beyond
PulseAugur coverage of Multimodal Large Language Models and Tunings: Vision, Language, Sensors, Audio, and Beyond — every cluster mentioning Multimodal Large Language Models and Tunings: Vision, Language, Sensors, Audio, and Beyond across labs, papers, and developer communities, ranked by signal.
- instance of alphaXiv 90%
- instance of Gotit.pub 90%
- instance of ScienceCast 90%
- instance of CatalyzeX 90%
- instance of CORE Recommender 90%
- instance of Qwen2.5-VL-7B 90%
- instance of IU-Xray 90%
- developed Multimodal Continual Instruction Tuning 90%
- instance of Qwen2.5-VL 90%
- used by ScienceCast 70%
- used by Gotit.pub 70%
- instance of train of thought 70%
- 2026-10-25 research_milestone A new framework using MLLMs was developed to scale surgical instrument localization with bounding boxes, creating a large dataset. source
18 day(s) with sentiment data
-
New framework uses LLMs for improved diagnosis of cystic lung diseases
Researchers have developed DCLDs-EIR, a novel framework designed to improve the diagnosis of Diffuse Cystic Lung Diseases (DCLDs). This system leverages Multimodal Large Language Models (MLLMs) to integrate imaging and …
-
MLLMs tested as human surrogates for Explainable AI evaluation
Researchers have explored the use of Multimodal Large Language Models (MLLMs) as a substitute for human evaluation in the field of Explainable AI (XAI). A new framework was developed to measure explanation utility for b…
-
New AI methods enhance multimodal reasoning with visual grounding and adaptive refocusing
Researchers have developed new methods to improve multimodal commonsense reasoning in AI models. MMCOMET is a large-scale knowledge graph that grounds commonsense triples with visual information, outperforming text-only…
-
New ROSE framework enhances lifelong knowledge editing in multimodal LLMs
Researchers have introduced ROSE, a novel framework designed to improve lifelong knowledge editing in multimodal large language models (MLLMs). This approach aims to mitigate catastrophic forgetting and locality erosion…
-
New benchmark StreamGaze tests LLMs' gaze-guided video reasoning
Researchers have introduced StreamGaze, a novel benchmark designed to evaluate how effectively Multimodal Large Language Models (MLLMs) can utilize human gaze signals for temporal and proactive reasoning in streaming vi…
-
ImagineAgent framework enhances HOI comprehension using generative world modeling
Researchers have introduced ImagineAgent, a novel framework designed to enhance open-vocabulary human-object interaction (HOI) comprehension in multimodal large language models. The agent addresses limitations such as c…
-
New UMBench benchmark evaluates fine-grained visual reasoning in urban remote sensing MLLMs
A new benchmark called UMBench has been developed to evaluate the fine-grained visual reasoning capabilities of multimodal large language models (MLLMs) in the context of urban remote sensing. This benchmark, built usin…
-
New framework tackles MLLM hallucinations using entropy dynamics
Researchers have developed a novel framework to address hallucinations in multimodal large language models (MLLMs) by analyzing the dynamics of information entropy during the reasoning process. The study identifies spec…
-
TraceRouter++ framework realigns LLM safety pathways using optimal transport
Researchers have introduced TraceRouter++, a novel framework designed to enhance the safety of large foundation models (LFMs) by realigning causal semantic routing pathways. Unlike existing methods that focus on localiz…
-
New BEAKER benchmark tests AI's embodied reasoning in chemical labs
Researchers have introduced BEAKER, a new benchmark designed to evaluate the embodied capabilities of Multimodal Large Language Models (MLLMs) in self-driving chemical laboratories. The benchmark consists of 1,000 exper…
-
New PSGAgent framework enhances MLLMs' visual perception for scene graph generation
Researchers have developed PSGAgent, a new framework designed to improve how Multimodal Large Language Models (MLLMs) understand complex visual scenes for Panoptic Scene Graph generation (PSG). Current MLLMs are limited…
-
New BEAKER benchmark tests AI's embodied reasoning in chemical labs
Researchers have introduced BEAKER, a new benchmark designed to evaluate the embodied capabilities of Multimodal Large Language Models (MLLMs) in self-driving chemical laboratories (SDCLs). BEAKER comprises 1,000 expert…
-
AI models struggle with scientific claim verification despite advances
Two recent papers explore the challenge of verifying scientific claims against their source material, particularly focusing on multimodal large language models (LLMs). The NTCIR-19 SciClaimEval task involved 22 teams us…
-
FactEmbed enhances Composed Image Retrieval using factorized MLLM embeddings · 4 sources tracked
Researchers have introduced FactEmbed, a novel approach to Composed Image Retrieval (CIR) that enhances the utilization of Multimodal Large Language Models (MLLMs). Unlike previous methods that directly map composed que…
-
Open-weight MLLMs struggle with visual comparison tasks, paper finds
A new arXiv paper investigates the limitations of open-weight Multimodal Large Language Models (MLLMs) in performing visual comparisons, particularly in biological image analysis. Researchers found that even simple task…
-
New framework audits safety labels in multimodal LLM benchmarks
Researchers have developed a new framework called the Benchmark Card to analyze the reliability of situational-safety benchmarks used for multimodal large language models (MLLMs). This framework identifies seven distinc…
-
New benchmark reveals LLMs struggle with ECG clinical reasoning
Researchers have introduced the ECG-Reasoning-Benchmark, a new evaluation framework designed to assess the clinical reasoning capabilities of multimodal large language models (MLLMs) in interpreting electrocardiograms (…
-
New dataset and evaluation framework for MLLM audio descriptions released
Researchers have introduced MTG-AD, a new dataset and evaluation framework designed to assess the performance of multimodal large language models (MLLMs) in generating inline audio descriptions for videos. The MTG-AD da…
-
New task enables AI to identify film characters and names from movie content
Researchers have introduced a new task called character naming, which aims to identify principal characters and assign their names directly from a film's dialogue and visual cues. This approach bypasses the need for ext…
-
New MLCCD method improves multimodal fake news detection
Researchers have developed a new method called Multi-Level Consistency and Conflict Decoupling (MLCCD) to improve the detection of multimodal fake news. This approach leverages the distinct knowledge encoded across diff…