Researchers have introduced InterPet4D, a novel multimodal dataset designed to advance the study of human-pet interaction, particularly in motion generation. This dataset comprises 6.8 million frames of synchronized multi-view and egocentric videos, along with detailed annotations for both humans and dogs, including keypoints, meshes, and audio. The accompanying InterPetMoGen framework, built using sequence-to-sequence learning and a Diffusion Transformer, demonstrates superior performance in generating realistic human-pet interactions, achieving an FID score of 11.21. AI
IMPACT This dataset and framework could enable more realistic AI-driven simulations and applications involving human-animal interactions.
RANK_REASON The cluster describes a new dataset and framework for human-pet interaction motion generation, which falls under research. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →