Core AI · Intermediate · 8-14 hours
Spatial Intelligence
Models that understand, generate, and reason about persistent 3D spaces rather than isolated images.
Direct answer
What is Spatial Intelligence?
Models that understand, generate, and reason about persistent 3D spaces rather than isolated images.
Definition and scope
Models that understand, generate, and reason about persistent 3D spaces rather than isolated images.
Spatial intelligence combines video prediction, 3D reconstruction, world generation, scene memory, and action-conditioned simulation.
Why it matters
Robots, AR assistants, and embodied agents need stable geometry, affordances, object permanence, and action consequences.
How it works
Spatial intelligence combines video prediction, 3D reconstruction, world generation, scene memory, and action-conditioned simulation.
Beginner learning path
Start with depth, camera geometry, 3D scene representation, and why video-only understanding is not enough for physical action.
Recommended next topics
Primary sources
Key papers
Genie 3: A General-Purpose World Model
Genie 3 generates interactive environments that can be explored in real time from text descriptions.
Cosmos 3: Omnimodal World Models for Physical AI
Cosmos 3 unifies language, image, video, audio, and action into an open world-model backbone for physical AI.
V-JEPA 2: Self-Supervised Video Models for Physical Planning
V-JEPA 2 learns predictive video representations that support visual understanding and zero-shot robot control.
Marble: A Multimodal World Model
Marble generates persistent 3D worlds from text, images, video, panoramas, or coarse 3D layouts.
GAIA-1: A Generative World Model for Autonomous Driving
GAIA-1 generates realistic driving scenarios conditioned on video, text, and vehicle actions.
Research ecosystem
Organizations working in this area
Organization
World Labs
Spatial intelligence, multimodal world models, generative 3D environments
View profile →Organization
Google DeepMind
World models, robot learning, VLA systems, embodied reasoning
View profile →Organization
NVIDIA
Robot foundation models, simulation, synthetic data, edge deployment, and functional safety
View profile →Organization
Meta AI
Embodied perception, video prediction, egocentric AI
View profile →Organization
Wayve
Embodied AI for autonomous driving
View profile →Common questions
Frequently asked questions
What is Spatial Intelligence?
Models that understand, generate, and reason about persistent 3D spaces rather than isolated images.
Why does Spatial Intelligence matter for Physical AI?
Robots, AR assistants, and embodied agents need stable geometry, affordances, object permanence, and action consequences.
How should a beginner learn Spatial Intelligence?
Start with depth, camera geometry, 3D scene representation, and why video-only understanding is not enough for physical action.