研究人员推出了 InteractWeb-Bench，这是一个旨在评估多模态大语言模型（MLLMs）在网站生成任务中的新基准。该基准模拟了用户指令可能模糊或矛盾的真实世界条件，这种情况被称为“盲执行”。使用 InteractWeb-Bench 进行的实验表明，当前前沿的基于 MLLM 的代理在这些复杂场景中难以进行意图识别和自适应交互。该基准包含一个交互式环境，具有 Clarify、Implement、Verify 和 Submit 等操作，以促进迭代改进。 AI
影响 新基准突显了当前多模态代理在网站生成方面的局限性，表明需要改进意图识别和交互能力。
排序理由 这是一篇介绍用于评估多模态模型的新基准的研究论文。
AI 生成摘要 · Google Gemini · 来自 9 个来源。 我们如何撰写摘要 →
arXiv:2604.27419v1 Announce Type: new Abstract: With the advancement of multimodal large language models (MLLMs) and coding agents, the website development has shifted from manual programming to agent-based project-level code synthesis. Existing benchmarks rely on idealized assum…
With the advancement of multimodal large language models (MLLMs) and coding agents, the website development has shifted from manual programming to agent-based project-level code synthesis. Existing benchmarks rely on idealized assumptions, especially for well-structured, informat…
arXiv:2604.26221v1 Announce Type: new Abstract: Open-vocabulary semantic segmentation (OVSS) in remote sensing images is a promising task that employs textual descriptions for identifying undefined land cover categories. Despite notable advances, existing methods typically employ…
arXiv:2602.13780v2 Announce Type: replace Abstract: Remote sensing (RS) change detection is essential for interpreting surface dynamics. Semantic change detection (SCD) further enables pixel-level understanding of multi-class transitions, yet remains sensitive to pseudo-changes i…
Open-vocabulary semantic segmentation (OVSS) in remote sensing images is a promising task that employs textual descriptions for identifying undefined land cover categories. Despite notable advances, existing methods typically employ a static inference paradigm, overlooking the di…
arXiv:2604.24031v1 Announce Type: new Abstract: The encoder-decoder framework has become widely popular nowadays. In this model, the encoder extracts informative visual features from an input image, and the decoder employs a sequence-to-sequence formulation to generate the corres…
arXiv:2604.23309v1 Announce Type: new Abstract: Remote sensing image change captioning (RSICC) aims to describe the difference between two remote sensing images. While recent methods have explored video modeling, they largely overlook the inherent ambiguities in viewpoint, scale,…
arXiv:2604.22855v1 Announce Type: new Abstract: The core objective of image captioning is to achieve lossless semantic compression from visual signals into textual modalities. However, the reliance on manually curated reference texts for evaluation essentially forces models to mi…
The encoder-decoder framework has become widely popular nowadays. In this model, the encoder extracts informative visual features from an input image, and the decoder employs a sequence-to-sequence formulation to generate the corresponding textual description from these features.…