PulseAugur
LIVE 12:25:26
research · [1 source] ·
0
research

OpenAI trains Minecraft agent using unlabeled video and imitation learning

OpenAI has developed a new method called Video PreTraining (VPT) to train AI agents using vast amounts of unlabeled online video data. This technique involves first training an inverse dynamics model on a small set of labeled videos to predict actions, which then labels a larger dataset. The trained model, demonstrated in Minecraft, can perform complex tasks like crafting diamond tools, showcasing a step towards general AI agents capable of interacting with computer interfaces. AI

Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →

RANK_REASON OpenAI released a paper detailing a new training methodology for AI agents using video data, which is a research advancement.

Read on OpenAI News →

OpenAI trains Minecraft agent using unlabeled video and imitation learning

COVERAGE [1]

  1. OpenAI News TIER_1 ·

    Learning to play Minecraft with Video PreTraining

    We trained a neural network to play Minecraft by Video PreTraining (VPT) on a massive unlabeled video dataset of human Minecraft play, while using only a small amount of labeled contractor data. With fine-tuning, our model can learn to craft diamond tools, a task that usually tak…