New framework generates Human-Human-Object Interactions from text

Researchers have introduced a new problem formulation called Human-Human-Object Interactions (HHOIs) to model complex, context-dependent behaviors involving multiple people and objects. To address the lack of dedicated datasets, they developed a new HHOIs dataset and a method to synthesize data using image generative models. Their approach trains text-to-HOI and text-to-HHI models using score-based diffusion models, integrating them into a unified generative framework capable of synthesizing complete HHOIs conditioned on textual descriptions. AI

IMPACT This research could lead to more sophisticated AI systems capable of understanding and generating complex human behaviors in scenes, impacting areas like robotics and virtual reality.

RANK_REASON This is a research paper detailing a new problem formulation and method for generating Human-Human-Object Interactions. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• Sangwon Baik

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →