New GESTO memory system enables robots to reason about human activities

Researchers have introduced GESTO, a novel spatio-temporal memory system designed for robots operating in dynamic human environments. GESTO integrates a persistent 4D scene graph with a hierarchical structure of atomic human-object interactions and goal-driven events. The system automatically extracts timestamped interactions from RGB-D data, grounds them to scene entities, and groups them into events, which in turn refine object associations. A relation-aware agent can then query this memory for activity-centric reasoning, demonstrating improved performance on existing benchmarks and new queries for event and space reasoning. AI

IMPACT Enables robots to better understand and interact within complex, dynamic human environments by reasoning about activities.

RANK_REASON Academic paper detailing a new method for robot memory and reasoning. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• alphaXiv
• arXiv
• CatalyzeX
• DagsHub
• Event2Space
• Gotit.pub
• Hugging Face
• Human-Centric Spatio-Temporal Memory for Reasoning in Dynamic Scenes
• RGB-D Visual Simultaneous Localization and Mapping (SLAM) Application
• ScienceCast
• Space2Event

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →