Fix post-build-script #8982

NicolasHug · 2025-03-18T10:14:02Z

Job has been failing with various issues

The CUDA_HOME variable wasn't set on some job which led to a failure.

Also, lddtree must be imported differently from auditwheel 6.3 as mentioned in #8981:

ImportError: cannot import name 'lddtree' from 'auditwheel.lddtree' (/__w/_temp/conda_environment_13920830566/lib/python3.9/site-packages/auditwheel/lddtree.py)

And we didn't know this job was failing because we didn't raise on failure. So wheel relocation has been silently failing, which was probably causing all wheel jobs to fail: #8980

So, hopefully, this PR fixes all this mess. UGH.

Fixes #8981
Fixes #8980

pytorch-bot · 2025-03-18T10:14:05Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/vision/8982

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

⏳ No Failures, 1 Pending

As of commit 0cf06a8 with merge base ade1c9b ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

NicolasHug · 2025-03-18T11:28:12Z

All jobs are green (finally), merging.

github-actions · 2025-03-18T11:28:33Z

Hey @NicolasHug!

You merged this PR, but no labels were added.
The list of valid labels is available at https://github.com/pytorch/vision/blob/main/.github/process_commit.py

(cherry picked from commit 29066f5)

Observing aarch64 failure in nightly: https://github.com/pytorch/pytorch/actions/runs/13917778961/job/38943911228 Similar to: pytorch/vision#8982 ``` 2025-03-18T08:44:58.4128744Z Repairing Wheel with AuditWheel 2025-03-18T08:44:58.5440988Z INFO:auditwheel.main_repair:Repairing torch-2.8.0.dev20250318+cpu-cp39-cp39-linux_aarch64.whl 2025-03-18T08:45:20.3393288Z Traceback (most recent call last): 2025-03-18T08:45:20.3393732Z File "/opt/python/cp39-cp39/bin/auditwheel", line 8, in <module> 2025-03-18T08:45:20.3394115Z sys.exit(main()) 2025-03-18T08:45:20.3394559Z File "/opt/_internal/cpython-3.9.21/lib/python3.9/site-packages/auditwheel/main.py", line 53, in main 2025-03-18T08:45:20.3395064Z result: int | None = args.func(args, p) 2025-03-18T08:45:20.3395626Z File "/opt/_internal/cpython-3.9.21/lib/python3.9/site-packages/auditwheel/main_repair.py", line 203, in execute 2025-03-18T08:45:20.3396163Z out_wheel = repair_wheel( 2025-03-18T08:45:20.3396657Z File "/opt/_internal/cpython-3.9.21/lib/python3.9/site-packages/auditwheel/repair.py", line 84, in repair_wheel 2025-03-18T08:45:20.3397184Z raise ValueError(msg) 2025-03-18T08:45:20.3397620Z ValueError: Cannot repair wheel, because required library "libarm_compute.so" could not be located 2025-03-18T08:45:20.3678843Z Traceback (most recent call last): 2025-03-18T08:45:20.3679267Z File "/pytorch/.ci/aarch64_linux/aarch64_wheel_ci_build.py", line 236, in <module> 2025-03-18T08:45:20.3680988Z pytorch_wheel_name = complete_wheel("/pytorch/") 2025-03-18T08:45:20.3681449Z File "/pytorch/.ci/aarch64_linux/aarch64_wheel_ci_build.py", line 141, in complete_wheel 2025-03-18T08:45:20.3681976Z check_call(["auditwheel", "repair", f"dist/{wheel_name}"], cwd=folder) 2025-03-18T08:45:20.3682860Z File "/opt/python/cp39-cp39/lib/python3.9/subprocess.py", line 373, in check_call 2025-03-18T08:45:20.3683308Z raise CalledProcessError(retcode, cmd) 2025-03-18T08:45:20.3684034Z subprocess.CalledProcessError: Command '['auditwheel', 'repair', 'dist/torch-2.8.0.dev20250318+cpu-cp39-cp39-linux_aarch64.whl']' returned non-zero exit status 1. 2025-03-18T08:45:20.3790063Z ##[error]Process completed with exit code 1. 2025-03-18T08:45:20.3862012Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2025-03-18T08:45:20.3862448Z with: ``` Please note aarch64 CUDA failures are related to: #149351 Pull Request resolved: #149471 Approved by: https://github.com/malfet

Observing aarch64 failure in nightly: https://github.com/pytorch/pytorch/actions/runs/13917778961/job/38943911228 Similar to: pytorch/vision#8982 ``` 2025-03-18T08:44:58.4128744Z Repairing Wheel with AuditWheel 2025-03-18T08:44:58.5440988Z INFO:auditwheel.main_repair:Repairing torch-2.8.0.dev20250318+cpu-cp39-cp39-linux_aarch64.whl 2025-03-18T08:45:20.3393288Z Traceback (most recent call last): 2025-03-18T08:45:20.3393732Z File "/opt/python/cp39-cp39/bin/auditwheel", line 8, in <module> 2025-03-18T08:45:20.3394115Z sys.exit(main()) 2025-03-18T08:45:20.3394559Z File "/opt/_internal/cpython-3.9.21/lib/python3.9/site-packages/auditwheel/main.py", line 53, in main 2025-03-18T08:45:20.3395064Z result: int | None = args.func(args, p) 2025-03-18T08:45:20.3395626Z File "/opt/_internal/cpython-3.9.21/lib/python3.9/site-packages/auditwheel/main_repair.py", line 203, in execute 2025-03-18T08:45:20.3396163Z out_wheel = repair_wheel( 2025-03-18T08:45:20.3396657Z File "/opt/_internal/cpython-3.9.21/lib/python3.9/site-packages/auditwheel/repair.py", line 84, in repair_wheel 2025-03-18T08:45:20.3397184Z raise ValueError(msg) 2025-03-18T08:45:20.3397620Z ValueError: Cannot repair wheel, because required library "libarm_compute.so" could not be located 2025-03-18T08:45:20.3678843Z Traceback (most recent call last): 2025-03-18T08:45:20.3679267Z File "/pytorch/.ci/aarch64_linux/aarch64_wheel_ci_build.py", line 236, in <module> 2025-03-18T08:45:20.3680988Z pytorch_wheel_name = complete_wheel("/pytorch/") 2025-03-18T08:45:20.3681449Z File "/pytorch/.ci/aarch64_linux/aarch64_wheel_ci_build.py", line 141, in complete_wheel 2025-03-18T08:45:20.3681976Z check_call(["auditwheel", "repair", f"dist/{wheel_name}"], cwd=folder) 2025-03-18T08:45:20.3682860Z File "/opt/python/cp39-cp39/lib/python3.9/subprocess.py", line 373, in check_call 2025-03-18T08:45:20.3683308Z raise CalledProcessError(retcode, cmd) 2025-03-18T08:45:20.3684034Z subprocess.CalledProcessError: Command '['auditwheel', 'repair', 'dist/torch-2.8.0.dev20250318+cpu-cp39-cp39-linux_aarch64.whl']' returned non-zero exit status 1. 2025-03-18T08:45:20.3790063Z ##[error]Process completed with exit code 1. 2025-03-18T08:45:20.3862012Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2025-03-18T08:45:20.3862448Z with: ``` Please note aarch64 CUDA failures are related to: #149351 Pull Request resolved: #149471 Approved by: https://github.com/malfet (cherry picked from commit 4df66e0)

Relates to ROCm/vision#7 Cherry pick of this pytorch/vision#8982 https://ontrack-internal.amd.com/browse/SWDEV-522276 Validation:http://rocm-ci.amd.com/job/pytorch2.4-manylinux-wheels_rel-6.4/23/

Relates to ROCm/vision#7 Cherry pick of this pytorch/vision#8982 https://ontrack-internal.amd.com/browse/SWDEV-522276 Validation:http://rocm-ci.amd.com/job/pytorch2.5-manylinux-wheels_rel-6.4/35/ --------- Co-authored-by: Pruthvi Madugundu <pruthvigithub@gmail.com>

Relates to ROCm/vision#7 Cherry pick of this pytorch/vision#8982 https://ontrack-internal.amd.com/browse/SWDEV-522276 Validation: http://rocm-ci.amd.com/job/pytorch2.6-manylinux-wheels_rel-6.4-preview/9/ Co-authored-by: Pruthvi Madugundu <pruthvigithub@gmail.com>

Relates to ROCm/vision@c77cacd Cherry pick of this pytorch/vision#8982 https://ontrack-internal.amd.com/browse/SWDEV-522276 Validation: http://rocm-ci.amd.com/job/pytorch2.3-manylinux-wheels_rel-6.4/21/

Relates to ROCm/vision@c77cacd Cherry pick of this pytorch/vision#8982 https://ontrack-internal.amd.com/browse/SWDEV-522276 Validation:: http://rocm-ci.amd.com/job/pytorch2.0-manylinux-wheels_rel-6.4/22/

Fix post-build-script

dcd783b

facebook-github-bot added the cla signed label Mar 18, 2025

NicolasHug added 3 commits March 18, 2025 10:22

Protect CUDA_HOME

4008962

Fix lddtree import

4aed867

Install auditwheel < 6.3.0

0cf06a8

NicolasHug mentioned this pull request Mar 18, 2025

packaging/wheel/relocate.py failed for auditwheel>=6.3 #8981

Closed

NicolasHug merged commit 29066f5 into pytorch:main Mar 18, 2025
60 checks passed

NicolasHug added a commit to NicolasHug/vision that referenced this pull request Mar 18, 2025

Fix post-build-script (pytorch#8982)

efb6387

This was referenced Mar 18, 2025

[release/0.19] Fix post-build-script ROCm/vision#7

Merged

[Release/2.4] Update related_commits for vision ROCm/pytorch#1975

Merged

jithunnair-amd pushed a commit to ROCm/vision that referenced this pull request Mar 18, 2025

Fix post-build-script (pytorch#8982)

c77cacd

(cherry picked from commit 29066f5)

jithunnair-amd pushed a commit to ROCm/vision that referenced this pull request Mar 18, 2025

Fix post-build-script (pytorch#8982)

04d8fc4

(cherry picked from commit 29066f5)

jithunnair-amd pushed a commit to ROCm/vision that referenced this pull request Mar 18, 2025

Fix post-build-script (pytorch#8982)

4040d51

(cherry picked from commit 29066f5)

atalman mentioned this pull request Mar 19, 2025

Pin auditwheel to 6.2.0 pytorch/pytorch#149471

Closed

pytorchbot mentioned this pull request Mar 19, 2025

Pin auditwheel to 6.2.0 pytorch/pytorch#149525

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix post-build-script #8982

Fix post-build-script #8982

NicolasHug commented Mar 18, 2025 •

edited

Loading

pytorch-bot bot commented Mar 18, 2025 •

edited

Loading

NicolasHug commented Mar 18, 2025

github-actions bot commented Mar 18, 2025

Fix post-build-script #8982

Fix post-build-script #8982

Conversation

NicolasHug commented Mar 18, 2025 • edited Loading

pytorch-bot bot commented Mar 18, 2025 • edited Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/vision/8982

⏳ No Failures, 1 Pending

NicolasHug commented Mar 18, 2025

github-actions bot commented Mar 18, 2025

NicolasHug commented Mar 18, 2025 •

edited

Loading

pytorch-bot bot commented Mar 18, 2025 •

edited

Loading