How Cosmos 3 Helps Physical AI Think Before It Acts

NVIDIA Cosmos 3 uses a mixture-of-transformers architecture that pairs a reasoning transformer with a generation transformer, enabling it to understand object interactions and spatial-temporal relationships before generating video and action trajectories. It is the world's first fully open omnimodel that can understand and generate text, images, video, ambient sound and actions with physics accuracy, reducing physical AI training and evaluation cycles from months to days. Trained on billions of multimodal samples, it provides developers a foundation for building physical AI systems with reduced data and training costs.

Source: NVIDIA Blog | 2026-06-01