Enable Cuda 124 CI [20240516 rebase]

[nWEIdia]

Opening this PR to preserve the test log of #121956 , since force push will overwrite HUD results, e.g. https://hud.pytorch.org/pytorch/pytorch/pull/121956?sha=f22f184e1ff61df30547b09e281bb47aebb085e3

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/126515

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 5 Unrelated Failures

As of commit e36c5d7 with merge base d2f5a8a ():

NEW FAILURES - The following jobs have failed:

• docker-builds / docker-build (linux.12xlarge, pytorch-linux-focal-cuda12.4-cudnn8-py3.12-gcc9-inductor-benchmarks) (gh)
  name unknown: The repository with name 'pytorch/pytorch-linux-focal-cuda12.4-cudnn8-py3.12-gcc9-inductor-benchmarks' does not exist in the registry
• Lint / lintrunner-noclang / linux-job (gh)
  >>> Lint for .github/workflows/inductor.yml:
• slow / linux-focal-cuda12.4-py3-gcc9-slow-gradcheck / test (default, 1, 6, linux.g5.4xlarge.nvidia.gpu) (gh)
  'Test'
• slow / linux-focal-rocm6.1-py3.8 / test (slow, 1, 1, linux.rocm.gpu) (gh)
  Process completed with exit code 1.
• trunk / libtorch-linux-focal-cuda12.4-py3.7-gcc9-debug / build (gh)
  /var/lib/jenkins/workspace/aten/src/ATen/cuda/CUDASparseDescriptors.h:119:68: error: ‘cusparseStatus_t cusparseCreateBsrsm2Info(bsrsm2Info**)’ is deprecated: The routine will be removed in the next major release [-Werror=deprecated-declarations]

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• inductor-periodic / cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) (gh) (similar failure)
  hf_BigBird
• inductor-periodic / cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamic_aot_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) (gh) (similar failure)
  hf_BigBird
• inductor-periodic / cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_torchbench, 1, 2, linux.g5.4xlarge.nvidia.gpu) (gh) (similar failure)
  hf_BigBird
• pull / linux-focal-cuda12.4-py3.10-gcc9-sm86 / test (default, 2, 5, linux.g5.4xlarge.nvidia.gpu) (gh) (similar failure)
  inductor/test_efficient_conv_bn_eval.py::EfficientConvBNEvalCudaTests::test_basic_cuda
• slow / linux-focal-cuda12.4-py3-gcc9-slow-gradcheck / test (default, 6, 6, linux.g5.4xlarge.nvidia.gpu) (gh) (disabled by #126489)
  inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[pytorch-bot]

Warning: Unknown label ciflow/inductor-perf-test-nightly.
Currently recognized labels are

• ciflow/binaries
• ciflow/binaries_conda
• ciflow/binaries_libtorch
• ciflow/binaries_wheel
• ciflow/inductor
• ciflow/inductor-perf-compare
• ciflow/inductor-micro-benchmark
• ciflow/linux-aarch64
• ciflow/mps
• ciflow/nightly
• ciflow/periodic
• ciflow/rocm
• ciflow/slow
• ciflow/trunk
• ciflow/unstable
• ciflow/xpu
• ciflow/torchbench

Please add the new label to .github/pytorch-probot.yml

[nWEIdia]

Closing to avoid confusion.