Llava
PulseAugur coverage of Llava — every cluster mentioning Llava across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
Developer builds free local AI alt text generator using LLaVA and Ollama
A developer created a local, free-to-run AI-powered tool for generating alt text for website images. The tool utilizes LLaVA, a vision-language model, and Ollama for local model execution, eliminating the need for API k…
-
New framework reveals vision-language models' sensitivity to combined image and text changes
Researchers have developed MoST, a novel testing framework designed to evaluate the modality sensitivity of vision-language models (VLMs). MoST employs a search-based approach to combine image and text perturbations, re…
-
New ASaRG method enhances LLaVA for medical report generation
Researchers have developed ASaRG, a novel approach that enhances the LLaVA architecture for automatic fine-grained segmentation-assisted report generation in medical imaging. By integrating intermediate features and seg…
-
LLaVA-CKD framework improves vision-language model efficiency via cascaded distillation
Researchers have developed LLaVA-CKD, a novel bottom-up cascaded knowledge distillation framework designed to improve the efficiency of large Vision-Language Models (VLMs). This method addresses the challenge of knowled…
-
New ComCLIP Framework Enhances CLIP Vision Encoder for VLMs
Researchers have proposed ComCLIP, a new framework for refining CLIP's vision encoder, which is foundational for models like LLaVA. Contrary to previous findings, they demonstrate that contrastive post-training can be e…
-
New frameworks enhance vision-language models for specialized tasks · 2 sources tracked
Researchers have developed two novel frameworks for adapting vision-language models (VLMs) to specialized domains. The first, Inductive Visual Logic (IVL), uses a training-free approach to construct classification knowl…
-
ShieldCLIP framework enhances safety alignment for multimodal models
Researchers have introduced ShieldCLIP, a novel framework designed to enhance safety alignment in multimodal foundation models by selectively addressing harmful content. Unlike previous methods that treat all generated …
-
New multimodal models and research push AI capabilities across edge, reasoning, and generation
Several research papers and a new model release focus on advancing multimodal AI capabilities. Liquid Foundation Models has released the open-source d1-3B model, optimized for edge devices and capable of processing text…
-
New ViD Framework Tackles Gender Bias in Vision-Language Models
Researchers have introduced ViD, a novel framework designed to mitigate gender bias in large vision-language models (LVLMs). Unlike previous methods that require training-phase adjustments or post-hoc calibration, ViD a…
-
Unified Vision-Language Model Enhances PSMA PET/CT Analysis
Researchers have developed a novel unified vision-language model designed to enhance the analysis of PSMA PET/CT scans for prostate cancer management. This model integrates report generation, visual question answering, …
-
MLLMs Mimic Human Perception of Bistable Images
Researchers have investigated whether multimodal large language models (MLLMs) exhibit human-like reporting behavior when presented with bistable images, such as the classic duck-rabbit illusion. Using the LLaVA family …
-
Image augmentation techniques tested as generators for deep learning image retrieval systems
This paper introduces a novel approach to testing deep learning-based image retrieval systems by utilizing image augmentation techniques as test generators. The research categorizes 50 augmentation methods and empirical…
-
New ClustRS Algorithm Boosts VLM Efficiency and Robustness
Researchers have developed ClustRS, a novel two-part, training-free algorithm designed to enhance the efficiency and robustness of Visual-Language Models (VLMs). This method employs an attention-weighted clustering appr…
-
Developer runs multiple AI models locally via sequential loading
A developer details a strategy for running multiple large AI models on a single local server with limited VRAM by employing a sequential loading approach. This method involves loading a model, using it for a specific ta…
-
Stable Diffusion user seeks advice on image generation consistency
A user on Reddit's r/StableDiffusion subreddit is seeking advice on how to achieve specific composition control and product consistency in image generation. They are comparing results from various models including ChatG…
-
New methods enhance open-vocabulary segmentation using multimodal pseudo-labels and test-time adaptation
Researchers have developed new methods for open-vocabulary instance and panoptic segmentation, which aim to recognize objects beyond predefined categories without extensive manual annotation. One approach, detailed in a…
-
New Spanish-language cybersecurity vision-language model released
Researchers have developed VectraYX-Vision-1B, a compact vision-language model designed for Spanish and Latin American cybersecurity imagery. This model, under 2 billion parameters, integrates a SigLIP-SO400M encoder wi…
-
New Spanish Cybersecurity Vision-Language Model Shows Promise Despite Grounding Issues
Researchers have developed VectraYX-Vision-1B, a vision-language model designed for Spanish and Latin American cybersecurity imagery. This sub-2 billion parameter model integrates a SigLIP encoder with a Spanish securit…
-
New research explores multimodal alignment via optimal transport and latent denoising
Two new research papers explore methods for improving multimodal alignment in large models. The first paper introduces Joint Kernel Entropic Gromov--Wasserstein Optimal Transport (JK-EGW) to align data from different mo…
-
New frameworks enhance VLM reasoning with visual tokens and self-diagnosis · 3 sources tracked
Researchers have developed new frameworks to enhance the reasoning capabilities of Vision-Language Models (VLMs). One approach, Chain-of-Visual-Thought (COVT), uses continuous visual tokens to capture dense perceptual i…