Sapiens2 model family achieves state-of-the-art in human-centric vision tasks

Researchers have introduced Sapiens2, a new family of high-resolution transformer models designed for human-centric vision tasks. These models, ranging from 0.4 to 5 billion parameters, support native 1K resolution and hierarchical variants up to 4K. Sapiens2 achieves improved performance through a unified pretraining objective combining masked image reconstruction with self-distilled contrastive learning, training on a dataset of 1 billion human images, and architectural enhancements like windowed attention for longer spatial context. AI

IMPACT Introduces a new model architecture and pretraining strategy for human-centric vision tasks, potentially improving performance on downstream applications like pose estimation and segmentation.

RANK_REASON This is a research paper describing a new model family.

Read on arXiv cs.CV →

• arXiv
• Hugging Face
• Rawal Khirodkar
• Sapiens2

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →