Problem

Many cloud providers offer instances with ARM CPUs, which can sometimes be more cost-efficient. There are also accelerators that are only available along with an ARM CPU, such as the NVIDIA GH200 chip. dstack does not support running jobs on ARM CPUs.

Solution

Support running jobs on ARM CPUs.

Some things to consider:

• Research running amd64 Docker containers on arm64 hosts and impact on performance. Decide how and if dstack will handle architecture emulation for Docker.
• Add a build target for dstack-shim and possibly dstack-runner in CI.
• Distinguish arm64 and amd64 offers in gpuhunt and dstack and choose appropriate shim and runner builds when provisioning instances and starting jobs.
• Provide a way to specify the CPU architecture in on-prem fleets or detect it automatically.
• Provide a way to filter offers by architecture.
• Add ARM offers for at least one cloud provider.
• Build dstack OS images for ARM.
• Build dstack Docker images for ARM.

Workaround

No response

Would you like to help us implement this feature by sending a PR?

Yes