Skip to content
@nvidia-cosmos

NVIDIA Cosmos

NVIDIA Cosmos is a world foundation model platform for accelerating the development of physical AI systems.

NVIDIA Cosmos

Cosmos World Foundation Models come in three model types which can all be customized in post-training: cosmos-predict, cosmos-transfer, and cosmos-reason:

Predict Transfer Reason
Type World Generation Multi-Controlnet Reasoning VLM
Function Predict novel future frames given initial frames Transfer existing control frames into photoreal frames within a video clip Reason against frames within a video clip
Use Cases Data Generation & Policy Evaluation Data Augmentation Data Curation
Inputs Text, Image, Video Multiple Video Modalities such as RGB, Depth, Segmentation, and more. Video & Text
Outputs Video Video Text

Use Cases in Physical AI Development

Our world foundation models are purpose-built to accelerate improving performance in downstream model tasks in various stages, as illustrated here in the flywheel.

Cosmos Data Flywheel

Popular repositories Loading

  1. cosmos-reason1 cosmos-reason1 Public

    Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long chain-of-thought reasoning processes.

    Python 687 48

  2. cosmos-transfer1 cosmos-transfer1 Public

    Cosmos-Transfer1 is a world-to-world transfer model designed to bridge the perceptual divide between simulated and real-world environments.

    Python 645 93

  3. cosmos-predict2 cosmos-predict2 Public

    Cosmos-Predict2 is a collection of general-purpose world foundation models for Physical AI that can be fine-tuned into customized world models for downstream applications.

    Python 556 71

  4. cosmos-predict1 cosmos-predict1 Public

    Cosmos-Predict1 is a collection of general-purpose world foundation models for Physical AI that can be fine-tuned into customized world models for downstream applications.

    Jupyter Notebook 345 72

  5. cosmos-rl cosmos-rl Public

    Cosmos-RL is a flexible and scalable Reinforcement Learning framework specialized for Physical AI applications.

    Python 148 20

  6. cosmos-curate cosmos-curate Public

    Cosmos-Curate is a powerful video curation system that processes, analyzes, and organizes video content using advanced AI models and distributed computing.

    Python 67 13

Repositories

Showing 10 of 12 repositories
  • cosmos-rl Public

    Cosmos-RL is a flexible and scalable Reinforcement Learning framework specialized for Physical AI applications.

    nvidia-cosmos/cosmos-rl’s past year of commit activity
    Python 148 Apache-2.0 20 25 6 Updated Sep 9, 2025
  • cosmos-curate Public

    Cosmos-Curate is a powerful video curation system that processes, analyzes, and organizes video content using advanced AI models and distributed computing.

    nvidia-cosmos/cosmos-curate’s past year of commit activity
    Python 67 Apache-2.0 13 0 0 Updated Sep 8, 2025
  • cosmos-xenna Public

    Python library for building and running distributed data pipelines using Ray

    nvidia-cosmos/cosmos-xenna’s past year of commit activity
    Python 29 Apache-2.0 5 0 2 Updated Sep 8, 2025
  • cosmos-transfer1 Public

    Cosmos-Transfer1 is a world-to-world transfer model designed to bridge the perceptual divide between simulated and real-world environments.

    nvidia-cosmos/cosmos-transfer1’s past year of commit activity
    Python 645 Apache-2.0 93 18 5 Updated Sep 8, 2025
  • cosmos-predict2 Public

    Cosmos-Predict2 is a collection of general-purpose world foundation models for Physical AI that can be fine-tuned into customized world models for downstream applications.

    nvidia-cosmos/cosmos-predict2’s past year of commit activity
    Python 556 Apache-2.0 71 8 5 Updated Sep 5, 2025
  • cosmos-dependencies-staging Public Forked from nvidia-cosmos/cosmos-dependencies

    (Staging) Repository for pre-release testing of cosmos-dependencies.

    nvidia-cosmos/cosmos-dependencies-staging’s past year of commit activity
    Just 0 1 0 0 Updated Sep 4, 2025
  • nvidia-cosmos/cosmos-dependencies’s past year of commit activity
    Just 0 1 0 0 Updated Sep 3, 2025
  • flash-attention Public Forked from Dao-AILab/flash-attention

    Fast and memory-efficient exact attention

    nvidia-cosmos/flash-attention’s past year of commit activity
    Python 1 BSD-3-Clause 1,984 0 0 Updated Sep 2, 2025
  • cosmos-reason1 Public

    Cosmos-Reason1 models understand the physical common sense and generate appropriate embodied decisions in natural language through long chain-of-thought reasoning processes.

    nvidia-cosmos/cosmos-reason1’s past year of commit activity
    Python 687 Apache-2.0 48 1 3 Updated Aug 28, 2025
  • cosmos-predict1 Public

    Cosmos-Predict1 is a collection of general-purpose world foundation models for Physical AI that can be fine-tuned into customized world models for downstream applications.

    nvidia-cosmos/cosmos-predict1’s past year of commit activity
    Jupyter Notebook 345 Apache-2.0 72 4 6 Updated Aug 20, 2025

Most used topics

Loading…