[1/N] Dynamic Shape: To enable export.aot_compile to switch between static shape and dynamic shape

[EikanWang]

Stack from ghstack (oldest at bottom):

• [2/N] Dynamic Shape: Enable dynamic shape support for aoti_eager #126883
• -> [1/N] Dynamic Shape: To enable export.aot_compile to switch between static shape and dynamic shape #126517
• [4/N] Non-Tensor: Support layout, device and dtype for aten operations #125897
• [3/N] Non-Tensor: Support string parameter for aten operations #125831
• Separate AOTI Eager utils as a single file #125819
• Modularize aten parameter parser and checker #125308
• Support aten operations with out tensor #124926

cc @voznesenskym @penguinwu @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @peterbell10 @ipiszy @yf225 @chenyang78 @kadeng @muchulee8 @ColinPeppler @amjames @desertfire @chauhang

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/126517

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• Upgrade MacOS runner to 14

❌ 9 New Failures, 4 Unrelated Failures

As of commit 662f75c with merge base 10a92b5 ():

NEW FAILURES - The following jobs have failed:

• inductor / cuda12.1-py3.10-gcc9-sm86 / test (aot_inductor_torchbench, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  pyhpc_isoneutral_mixing
• inductor / cuda12.1-py3.10-gcc9-sm86 / test (inductor, 1, 1, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_dynamic_scalar_abi_compatible_cpu
• inductor / cuda12.1-py3.12-gcc9-sm86 / test (inductor, 1, 1, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_dynamic_scalar_abi_compatible_cpu
• inductor / cuda12.4-py3.10-gcc9-sm86 / test (aot_inductor_torchbench, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  pyhpc_isoneutral_mixing
• inductor / cuda12.4-py3.10-gcc9-sm86 / test (inductor, 1, 1, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_dynamic_scalar_abi_compatible_cpu
• inductor / cuda12.4-py3.12-gcc9-sm86 / test (inductor, 1, 1, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_dynamic_scalar_abi_compatible_cpu
• inductor / rocm6.1-py3.8-inductor / test (inductor, 1, 1, linux.rocm.gpu.2) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_dynamic_scalar_abi_compatible_cpu
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 2, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_dynamic_scalar_abi_compatible_cpu
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 3, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  inductor/test_aot_inductor.py::AOTInductorTestNonABICompatibleCuda::test_dynamic_scalar_non_abi_compatible_cuda

UNSTABLE - The following jobs failed but were likely due to flakiness present on trunk and has been marked as unstable:

• inductor / cuda12.1-py3.10-gcc9-sm86 / test (inductor_timm, 1, 2, linux.g5.4xlarge.nvidia.gpu, unstable) (gh) (#126884)
  cspdarknet53
• pull / linux-focal-cuda12.4-py3.10-gcc9-sm86 / test (default, 2, 5, linux.g5.4xlarge.nvidia.gpu, unstable) (gh) ()
  inductor/test_aot_inductor.py::AOTInductorTestABICompatibleCpu::test_dynamic_scalar_abi_compatible_cpu
• pull / linux-focal-cuda12.4-py3.10-gcc9-sm86 / test (default, 3, 5, linux.g5.4xlarge.nvidia.gpu, unstable) (gh) ()
  inductor/test_aot_inductor.py::AOTInductorTestNonABICompatibleCuda::test_dynamic_scalar_non_abi_compatible_cuda
• pull / linux-focal-cuda12.4-py3.10-gcc9-sm86 / test (default, 5, 5, linux.g5.4xlarge.nvidia.gpu, unstable) (gh) ()
  test_foreach.py::TestForeachCUDA::test_parity__foreach_add_fastpath_inplace_cuda_bfloat16

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[zhxchen17]

cc @angelayi

[angelayi]

Hi sorry, what is the context around this change? If you want all inputs to be dynamic, you should be passing in fields to dynamic_shapes. Also bump on removing the same_signature flag. We plan to get rid of _export_to_torch_ir, so those flags won't be available.