PulseAugur
EN
LIVE 18:04:52

Researchers use Transformers to generate reactive human motion from interaction data

Researchers have developed Transformer-based models to generate human motion in interactive scenarios, focusing on how one person's movement influences another's. They created a dataset from boxing videos to train and compare models like the simple Transformer, iTransformer, and Crossformer. The study found that a basic Transformer model, enhanced with person ID embeddings, effectively generated plausible, interaction-aware motions without posture collapse, outperforming more complex architectures that accumulated errors. AI

IMPACT Introduces a method for generating realistic, interaction-aware human motion, potentially impacting animation and virtual reality.

RANK_REASON Academic paper on a novel approach to human motion generation using Transformer models.

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Researchers use Transformers to generate reactive human motion from interaction data

COVERAGE [2]

  1. arXiv cs.CV TIER_1 English(EN) · Masato Soga, Ryuki Takebayashi ·

    Learning Reactive Human Motion Generation from Paired Interaction Data Using Transformer-Based Models

    arXiv:2604.22164v1 Announce Type: new Abstract: Recent advances in deep learning have enabled the generation of videos from textual descriptions as well as the prediction of future sequences from input videos. Similarly, in human motion modeling, motions can be generated from tex…

  2. arXiv cs.CV TIER_1 English(EN) · Ryuki Takebayashi ·

    Learning Reactive Human Motion Generation from Paired Interaction Data Using Transformer-Based Models

    Recent advances in deep learning have enabled the generation of videos from textual descriptions as well as the prediction of future sequences from input videos. Similarly, in human motion modeling, motions can be generated from text or predicted from a single person's motion seq…