新的基准和合成数据旨在提升AI的自我中心视频理解能力

报道来源 [4]

1. arXiv cs.CL TIER_1 English(EN) · Emmanuel Dupoux · 2026-05-18 21:30

   EgoBabyVLM：基于自然主义自我中心视频数据的跨模态学习基准测试

   Children acquire language grounding with remarkable robustness from limited visuo-linguistic input in ways that surpass today's best large multimodal models. Recent research suggests current vision-language models (VLMs) trained on curated web data fail to generalize to the spars…

2. Hugging Face Daily Papers TIER_1 English(EN) · 2026-05-18 17:54

   EgoExoMem：跨视图同步的自我中心和外中心视频的记忆推理

   Egocentric memory is widely used in embodied intelligence, but it may be insufficient for comprehensive spatial-temporal reasoning. Inspired by human recall from both field and observer perspectives, we introduce EgoExoMem, the first benchmark for cross-view memory reasoning over…

3. arXiv cs.CV TIER_1 English(EN) · Rainer Stiefelhagen · 2026-05-18 17:54

   EgoExoMem：跨视图同步自我中心与外中心视频的记忆推理

   Egocentric memory is widely used in embodied intelligence, but it may be insufficient for comprehensive spatial-temporal reasoning. Inspired by human recall from both field and observer perspectives, we introduce EgoExoMem, the first benchmark for cross-view memory reasoning over…

4. arXiv cs.CV TIER_1 English(EN) · Giovanni Maria Farinella · 2026-05-18 10:58

   EgoInteract：用于交互理解和预测的合成自我中心视频生成

   Collecting large-scale egocentric video datasets with dense spatial and temporal annotations is costly, slow, and often constrained by environmental biases, privacy constraints, and limited coverage of interaction patterns. While synthetic data has shown strong potential in sever…