Skip to content

Undefined symbol: cuOccupancyMaxActiveClusters #115075

@bhack

Description

@bhack

🐛 Describe the bug

torch.compile is failing on nightly:
Starting docker FROM pytorch/pytorch:2.1.0-cuda11.8-cudnn8-devel

pip install --upgrade --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu118

torch._dynamo.exc.BackendCompilerFailed: backend='inductor' raised:
 ImportError: /tmp/torchinductor_root/triton/0/4fcaf02726b7cedfebb83bbf158e9de6/cuda_utils.so: undefined symbol: cuOccupancyMaxActiveClusters

Versions

torch-2.2.0.dev20231204%2Bcu118-cp310-cp310-linux_x86_64.whl

cc @chauhang @penguinwu @bertmaher @int3 @davidberard98 @nmacchioni @chenyang78 @embg @peterbell10 @aakhundov @ezyang @msaroufim @wconstab @bdhirsh @anijain2305 @zou3519

Metadata

Metadata

Assignees

No one assigned

    Labels

    oncall: pt2triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleupstream tritonUpstream Triton Issue

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions