Lift inductor lowerings for jagged <-> padded dense kernels

[jbschlosser]

Stack from ghstack (oldest at bottom):

• (WIP) to_padded_tensor() triton kernel for NJT #121947
• NJT <-> padded dense conversions #125947
• Short-term fix to preserve NJT metadata cache in torch.compile #122836
• -> Lift inductor lowerings for jagged <-> padded dense kernels #125968
• Lift jagged -> padded dense forward / backward kernels from fbgemm_gpu #125946
• Use return_and_correct_aliasing() for NJT + compatible storage setting #126552

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @peterbell10 @ipiszy @yf225 @chenyang78 @kadeng @muchulee8 @ColinPeppler @amjames @desertfire @chauhang

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/125968

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 13 New Failures, 2 Unrelated Failures

As of commit 3600ae6 with merge base 980f5ac ():

NEW FAILURES - The following jobs have failed:

• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 1, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  RuntimeError: test_overrides 1/1 failed
• pull / linux-focal-cuda12.1-py3.10-gcc9-sm86 / test (default, 5, 5, linux.g5.4xlarge.nvidia.gpu) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCUDA::test_dummy_mha_with_nt_cuda
• pull / linux-focal-py3-clang9-android-ndk-r21e-gradle-custom-build-single / build-and-test (default, 1, 1, linux.2xlarge) (gh)
  undefined reference to 'at::native::_unsafe_set_storage_(at::Tensor&, c10::Storage)'
• pull / linux-focal-py3.11-clang10 / test (crossref, 1, 2, linux.2xlarge) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCPU::test_dummy_mha_with_nt_cpu
• pull / linux-focal-py3.11-clang10 / test (default, 3, 3, linux.2xlarge) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCPU::test_dummy_mha_with_nt_cpu
• pull / linux-focal-py3.12-clang10 / test (default, 3, 3, linux.2xlarge) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCPU::test_dummy_mha_with_nt_cpu
• pull / linux-focal-py3.12-clang10 / test (dynamo, 1, 3, linux.2xlarge) (gh)
  RuntimeError: test_overrides 1/1 failed
• pull / linux-focal-py3.8-clang10 / test (crossref, 1, 2, linux.2xlarge) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCPU::test_dummy_mha_with_nt_cpu
• pull / linux-focal-py3.8-clang10 / test (default, 3, 3, linux.2xlarge) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCPU::test_dummy_mha_with_nt_cpu
• pull / linux-focal-py3.8-clang10 / test (dynamo, 1, 3, linux.2xlarge) (gh)
  RuntimeError: test_overrides 1/1 failed
• pull / linux-jammy-py3.10-clang15-asan / test (default, 3, 6, linux.4xlarge) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCPU::test_dummy_mha_with_nt_cpu
• pull / linux-jammy-py3.8-gcc11 / test (default, 3, 3, linux.2xlarge) (gh)
  test_nestedtensor.py::TestNestedTensorSubclassCPU::test_dummy_mha_with_nt_cpu
• pull / linux-jammy-py3.8-gcc11-mobile-lightweight-dispatch-build / build (gh)
  undefined reference to at::native::unsafe_set_storage(at::Tensor&, c10::Storage)'`

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• inductor / linux-jammy-cpu-py3.8-gcc11-inductor / test (inductor_torchbench_cpu_smoketest_perf, 1, 1, linux.24xl.spr-metal) (gh) (similar failure)
  Process completed with exit code 1.
• pull / linux-focal-py3.11-clang10 / test (dynamo, 1, 3, linux.2xlarge) (gh) (disabled by #126178 but the issue was closed recently and a rebase is needed to make it pass)
  test_nn.py::TestNNDeviceTypeCPU::test_conv_empty_input_cpu_float64

This comment was automatically generated by Dr. CI and updates every 15 minutes.