PulseAugur
EN
LIVE 08:02:50

AI tools like ChatGPT and Gemini are being tested by scientists for multimodal paper analysis

A new study published on arXiv explores how blind and low-vision (BLV) scientists interact with AI tools like ChatGPT and Gemini to understand multimodal scientific papers. Researchers interviewed five BLV and five sighted scientists to identify current practices, accessibility workarounds, and preferences for AI-generated responses to visual content. The study found that vague descriptions and incorrect AI outputs can lead scientists to abandon these tools, and it offers a dataset of 115 queries and responses to aid future research in developing more accessible AI-powered scientific QA systems. AI

IMPACT This research highlights the need for more accessible AI tools in scientific research, potentially influencing future development of multimodal QA systems.

RANK_REASON The cluster contains an academic paper detailing research on AI tools for scientific document analysis. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

AI tools like ChatGPT and Gemini are being tested by scientists for multimodal paper analysis

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · Arnavi Chheda-Kothary, Lucy Lu Wang, Joseph Chee Chang, Jonathan Bragg ·

    Querying Multimodal Scientific Papers with AI: Practices and Preferences Across Blind, Low-Vision, and Sighted Scientists

    arXiv:2607.18514v1 Announce Type: cross Abstract: Visual diagrams, figures, and tables are central to scientific papers, and convey information beyond what is captured in text. While blind or low-vision (BLV) scientists have traditionally relied on static alternative text to acce…