-
Notifications
You must be signed in to change notification settings - Fork 25.3k
Open
Labels
oncall: pt2triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleupstream tritonUpstream Triton IssueUpstream Triton Issue
Description
🐛 Describe the bug
torch.compile
is failing on nightly:
Starting docker FROM pytorch/pytorch:2.1.0-cuda11.8-cudnn8-devel
pip install --upgrade --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu118
torch._dynamo.exc.BackendCompilerFailed: backend='inductor' raised:
ImportError: /tmp/torchinductor_root/triton/0/4fcaf02726b7cedfebb83bbf158e9de6/cuda_utils.so: undefined symbol: cuOccupancyMaxActiveClusters
Versions
torch-2.2.0.dev20231204%2Bcu118-cp310-cp310-linux_x86_64.whl
cc @chauhang @penguinwu @bertmaher @int3 @davidberard98 @nmacchioni @chenyang78 @embg @peterbell10 @aakhundov @ezyang @msaroufim @wconstab @bdhirsh @anijain2305 @zou3519
Lavenderjiang and akihironitta
Metadata
Metadata
Assignees
Labels
oncall: pt2triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleupstream tritonUpstream Triton IssueUpstream Triton Issue