Brief

Researchers have developed MedExpMem, a novel framework designed to enhance the diagnostic capabilities of vision-language models (VLMs) in medicine. This system allows VLMs to learn from their own diagnostic failures, accumulating expertise through experience memory rather than just static knowledge. MedExpMem organizes this experience into discriminative notes that guide differential reasoning, leading to accuracy improvements of up to 7.0% on a radiology benchmark. AI

Researchers have developed DiNa-LRM, a novel diffusion-native latent reward model designed to improve preference learning for diffusion and flow-matching models. This new approach formulates preference learning directly on noisy diffusion states, overcoming the domain mismatch issues associated with using Vision-Language Models (VLMs) for reward provision. DiNa-LRM offers competitive performance to state-of-the-art VLMs but at a significantly reduced computational cost, leading to faster and more efficient model alignment. AI

Researchers have developed CoReVAD, a novel framework for detecting anomalies in videos without requiring task-specific training. This approach leverages a single, frozen Vision-Language Model (VLM) to generate both anomaly scores and descriptive explanations. To refine these outputs, CoReVAD incorporates a Local Response Cleaning module for vision-text alignment and a softmax-based refinement with Gaussian smoothing for temporal context. AI

Researchers have developed a new benchmark to assess how well Vision-Language Models (VLMs) can understand images that have been compressed at low bitrates. The study identified that performance degradation is due to information loss during compression and VLM generalization failures. To address this, a universal VLM adaptor was proposed, which demonstrated a 10-30% improvement in VLM performance across various compression codecs and bitrates. AI

A security analysis highlights the risks associated with AI systems that interpret engineering blueprints, such as those developed at Skoltech. These systems, which use multimodal models to read and analyze architectural drawings and building codes, introduce new attack surfaces. Researchers warn of potential threats like steganographic prompt injection, where hidden instructions are embedded in blueprints, and data poisoning, which could lead to structurally unsound designs and catastrophic failures. AI

Researchers have developed VISAFF, a novel framework for recognizing emotions in conversations by focusing on visual cues from the active speaker. This approach leverages existing Vision-Language Models without requiring extensive fine-tuning, significantly reducing computational costs. VISAFF also incorporates a mechanism to dynamically integrate textual and acoustic information to address visual ambiguities, achieving competitive performance on emotion recognition tasks. AI

Researchers have developed a new pipeline using Vision-Language Models to improve the transcription and analysis of historical Italian parliamentary speeches. This approach leverages OCR for initial text extraction and then employs a large-scale Vision-Language Model to refine transcriptions, classify document elements, and identify speakers by analyzing both visual layout and text. The system also links identified speakers to a knowledge base, demonstrating significant improvements in transcription quality and speaker tagging compared to traditional methods. AI

Researchers explored using a Vision-Language Model (VLM) to detect learner attention in educational videos, a task previously handled by classical machine learning. The study utilized an eye-tracking dataset of 70 participants and employed Gemini 3 for analysis. Despite the novel approach, the VLM-based method did not outperform existing statistical baselines in predicting attention loss, highlighting current limitations of VLMs for real-time educational diagnostics. AI

Researchers have developed a new framework for ultrasound image analysis that mimics how sonographers actively zoom into specific regions before making a diagnosis. This "Zoom-then-Diagnose" approach aims to improve the accuracy of Vision-Language Models (VLMs) in medical contexts by enabling lesion-focused reasoning. The system also incorporates an uncertainty-aware reward mechanism to gauge prediction consistency, encouraging caution when ambiguity is present. Experiments on liver, breast, and thyroid datasets showed a significant improvement in lesion localization, indicating the model's enhanced diagnostic capabilities. AI

Researchers have introduced a new metric called Synergistic Faithfulness ($\mathcal{F}_{syn}$) to better evaluate the explainability of Vision-Language Models (VLMs). Current methods often fail because VLMs can answer visual questions using text alone, leading to contradictory evaluation results. This new metric, based on the Shapley Interaction Index, accurately isolates the joint contribution between modalities and is significantly faster than existing approaches. Evaluations using $\mathcal{F}_{syn}$ show that many VLM explainability methods overemphasize visual saliency and underperform compared to attention-based methods in capturing true cross-modal synergy. AI

Researchers have developed a method to enhance 3D vehicle labeling for self-driving cars by using Vision Language Models (VLMs) to infer vehicle make, model, and generation. This approach leverages zero-shot inference to provide accurate 3D bounding box dimensions, which can then be refined by human labelers. The study demonstrates that this VLM integration reduces manual labeling time and improves label quality, even in challenging scenarios like significant vehicle occlusion. AI

Researchers have introduced SDGBiasBench, a new benchmark designed to evaluate and mitigate biases in vision-language models (VLMs) concerning the Sustainable Development Goals (SDGs). The benchmark includes over 500,000 multiple-choice questions and 50,000 regression tasks, revealing that current VLMs often rely on SDG-specific priors rather than visual evidence. To address this, the team developed CADE, a training-free method that improves model accuracy by up to 25% and reduces estimation errors by 12 points. AI

Researchers have developed SpatioRoute, a novel method for enhancing zero-shot spatial reasoning in Vision-Language Models (VLMs). This approach dynamically routes incoming questions to tailored prompt templates without requiring additional training or 3D sensor data. SpatioRoute demonstrated consistent accuracy gains of up to 5% on the SQA3D benchmark, setting a new state-of-the-art for video-only spatial VQA. AI

A new research paper questions the effectiveness of latent tokens in vision-language models for visual reasoning. The study found that replacing these intermediate "imagination" tokens with uninformative ones did not impact model accuracy, suggesting they play a minimal causal role. The research identifies two main issues: existing datasets often provide insufficient information in latent tokens, and the tokens generated during inference deviate significantly from ideal representations, hindering their utility. AI

Researchers have developed a new method called Geometry-Aware Uncertainty Coresets (GAUC) to improve the reliability of visual in-context learning in histopathology. This training-free approach optimizes the selection of data examples used to condition vision-language models without requiring parameter updates. GAUC aims to enhance accuracy, calibration, and robustness against prompt variations by considering distributional fidelity, effective mutual information, and predictive variance. AI

Researchers have developed IAMFlow, a novel framework designed to improve the consistency and identity tracking in long video generation. This training-free method explicitly models and follows persistent entities across evolving prompts, preventing issues like identity drift and attribute loss. IAMFlow utilizes an LLM to extract entities and assign IDs, with a VLM refining attributes from rendered frames for precise tracking. The framework also includes an inference acceleration pipeline and a new benchmark, NarraStream-Bench, for evaluating narrative streaming video generation. AI

Researchers have introduced a new training paradigm called "Starve to Perceive" to address the issue of "lazy perception" in Vision-Language Models (VLMs). This phenomenon occurs when VLMs can achieve adequate accuracy using coarse visual inputs and language priors, thus lacking a true incentive to learn active visual search strategies like zooming or cropping. The "Starve to Perceive" method constrains the visual bandwidth, limiting each observation to a small token budget, which forces the model to engage in active perception for task completion. This minimal, plug-in modification to existing training pipelines resulted in an average relative improvement of 5% across various benchmarks without requiring architectural changes or auxiliary losses. AI

Researchers have developed a new diagnostic dataset and protocol called TRACE-Edit to evaluate how well semantic information is preserved when Vision-Language Models (VLMs) are used for video editing. Their findings indicate that the alignment process between VLMs and Diffusion Transformer models (DiTs) can significantly degrade fine-grained structural details, challenging the assumption of lossless semantic transfer. This research identifies the VLM-to-DiT alignment as a critical bottleneck and provides a foundation for developing improved multi-modal alignment architectures. AI

Researchers have developed Draw2Think, a new framework that enhances geometric reasoning in vision-language models by interacting with the GeoGebra constraint engine. This system uses a Propose-Draw-Verify loop to externalize hypotheses onto an executable canvas, ensuring geometric accuracy and allowing for auditable checks on both model construction and engine measurements. Draw2Think significantly improves the accuracy of geometric problem-solving and rendering scores on various benchmarks. AI

Researchers have developed CounterCount, a new framework designed to diagnose counting biases in Vision-Language Models (VLMs). The framework uses paired factual and counterfactual images to test whether VLMs rely on visual evidence or learned priors when object counts differ from typical knowledge. Evaluations revealed that current VLMs perform well on factual images but struggle with counterfactual changes, indicating a reliance on object-level priors even when visual evidence contradicts them. CounterCount also showed that models underweight attention to count-relevant visual tokens, and proposed an attention modulation strategy to improve accuracy. AI

Researchers have developed GraSP-VL, a method to better utilize frozen vision-language model (VLM) embeddings by treating their length as a semantic interface. This approach learns a shared prefix transform that allows shorter prefixes to represent coarse semantic roles and longer prefixes to reveal finer distinctions. Experiments on COCO/Flickr30K datasets show GraSP-VL effectively reorganizes VLM embeddings into a truncatable semantic prefix interface, outperforming simple compression techniques. AI

Researchers have developed a new framework called VLM-CC to improve cross-camera color constancy in images. This method iteratively refines color balance by using a vision-language model (VLM) to provide feedback on image corrections, rather than directly regressing RGB values. The VLM identifies residual color casts and guides the adjustment process until convergence, achieving state-of-the-art robustness across various datasets. AI

Researchers have explored a technique called cross-modal skill injection to efficiently transfer domain-specific expertise from large language models (LLMs) to vision-language models (VLMs). This method aims to induce new cross-modal capabilities without requiring extensive new training data or significant computational resources, unlike traditional fine-tuning. The study found that this skill injection is effective for instruction-following and cross-lingual tasks but less so for mathematical reasoning. Among tested methods, TA and DARE proved superior, with the research also providing a detailed analysis of their critical hyperparameter tuning. AI