Docker

Docker in Docker

Using Docker in a run configuration is now much easier. Just set docker to true:

type: task
name: docker-nvidia-smi

docker: true

commands:
  - docker run --gpus all nvidia/cuda:12.3.0-base-ubuntu22.04 nvidia-smi

resources:
  gpu: 1

This works with all run configuration types and supports both AMD and NVIDIA GPUs. It’s especially useful if you want to use the docker CLI in your commands—for example, to build Docker images.

The docker property is supported on all backends except vastai, runpod, and kubernetes, and is fully supported on SSH fleets as well.

Backends

CloudRift

The CloudRift team has added support for their GPU cloud, which can now be used with dstack.

To configure it, use a CloudRift API key in the backend configuration:

projects:
  - name: main
    backends:
      - type: cloudrift
        creds:
          type: api_key
          api_key: rift_2prgY1d0laOrf2BblTwx2B2d1zcf1zIp4tZYpj5j88qmNgz38pxNlpX3vAo

CloudRift offers competitive on-demand GPU pricing, with more GPUs and regions coming soon.

dstack apply -f examples/.dstack.yml -b cloudrift

 #  BACKEND                      RESOURCES                                    INSTANCE TYPE   PRICE
 1  cloudrift (us-east-nc-nr-1)  cpu=16 mem=100GB disk=1000GB RTX5090:32GB:1  rtx59-16c-nr.1  $0.65

If you encounter any issues with this backend, please report them.

Server

Public projects

You can now create public projects that any user on the server can join or leave without approval. Previously, all projects were private, and adding new members required manual action by an admin or manager—a step that’s redundant in high-trust environments.

Admins can change a project’s visibility at any time in the project settings.

Metrics

The server exports new Prometheus metrics:

• dstack_submit_to_provision_duration_seconds: Time from when a run has been submitted and first job provisioning
• dstack_pending_runs_total: Total number of pending runs

What's changed

• [Feature]: Property filter on Fleets, Models, Volumes pages by @olgenn in #2824
• [Bug]: Run/job status in UI/CLI is shown as provisioning instead of pulling by @peterschmidt85 in #2834
• [chore]: Fix annotation in update_service_desired_replica_count by @jvstme in #2840
• Add CloudRift backend by @6erun in #2771
• Fix Postgres deadlocks by @r4victor in #2843
• [UX] Simplify the use of Docker inside containers #2468 by @peterschmidt85 in #2828
• [Docs] Update docs and examples to reflect the docker property by @peterschmidt85 in #2831
• Add support for Tenstorrent n300 GPUs by @peterschmidt85 in #2827
• [Feature]: Property filter on Instances page by @olgenn in #2826
• [UI] Allow to hide the Tour panel by @olgenn in #2816
• Pr3 add join leave UI buttons by @haydnli-shopify in #2795
• Health metrics (Part 2) by @Nadine-H in #2796
• [Bug]: Use a unique token for log pagination instead of a timestamp by @peterschmidt85 in #2845
• Fix update project required permissions by @r4victor in #2846

New contributors

• @6erun made their first contribution in #2771

Full changelog: 0.19.15...0.19.16