2020 · Google Research · Advanced
DreamerV2
DreamerV2 extends latent imagination with discrete representations and reaches human-level Atari performance.
Direct answer
What does DreamerV2 contribute?
DreamerV2 extends latent imagination with discrete representations and reaches human-level Atari performance.
Background
The model predicts compact discrete latent states and trains actor-critic components from imagined sequences. This improved stability and scalability across visually complex discrete-action tasks.
Problem
The work addresses a central constraint in World Models: building systems that learn useful representations or actions while remaining general enough to transfer beyond a single demonstration or environment.
Core idea
DreamerV2 extends latent imagination with discrete representations and reaches human-level Atari performance.
Architecture and method
The model predicts compact discrete latent states and trains actor-critic components from imagined sequences. This improved stability and scalability across visually complex discrete-action tasks.
- Discrete latent states
- Improved world-model learning
- Human-level Atari results
Results and impact
It showed a single model-based method could compete broadly on Atari without task-specific engineering.
Prerequisites
- Dreamer
- Variational inference
- Actor-critic methods
Recommended reading order
Read the explanation above, review the related topic pages, then use the primary-source links below to inspect the abstract, figures, experiments, and released implementation.
Primary sources
External links are provided after the context needed to evaluate the work.
Follow-up research
Related papers and concepts
World Models
A compact latent model can let an agent learn behavior inside its own predicted environment.
Dreamer: Reinforcement Learning with Latent Imagination
Dreamer learns long-horizon behavior by propagating value gradients through imagined latent trajectories.
DreamerV3: Mastering Diverse Domains through World Models
DreamerV3 uses robust normalization and objectives to learn across more than 150 tasks with one configuration.
Genie: Generative Interactive Environments
Genie learns controllable interactive environments from unlabeled internet video.
Common questions
Frequently asked questions
What is the main idea of DreamerV2?
DreamerV2 extends latent imagination with discrete representations and reaches human-level Atari performance.
Why is DreamerV2 important?
It showed a single model-based method could compete broadly on Atari without task-specific engineering.
What should I learn before reading DreamerV2?
Recommended prerequisites are Dreamer, Variational inference, Actor-critic methods.