🐛 Describe the bug

Please refer to following issue: #123649

With Migration to manylinux_2_28 (AlmaLinux 8 based) we would not be able to support OS distros with glibc2_26
#123649 (comment)

Here is the list of OS's and their GlibC versions:
https://repology.org/project/glibc/versions

As per this comment: #123649 (comment)
Suggestion is to still use old wheels for 2.4, announce the deprecation of old wheels during the release. For Release 2.5 - Use only new wheels.

As per: aws.amazon.com/amazon-linux-2/faqs
Amazon Linux 2 EOL: 2025-06-30

Versions

2.5.0

cc @seemethere @malfet @osalpekar @pytorch/pytorch-dev-infra @ezyang @albanD @snadampal