Enable FX graph caching for all benchmarks

[masnesral]

Stack from ghstack (oldest at bottom):

• -> Enable FX graph caching for all benchmarks #125980

Summary:

Test Plan:

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @chenyang78 @kadeng @chauhang

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/125980

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 15 Unrelated Failures

As of commit f33616e with merge base aac215a ():

NEW FAILURE - The following job has failed:

• inductor / cuda12.1-py3.10-gcc9-sm86 / test (dynamic_inductor_torchbench, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh)
  soft_actor_critic

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• inductor / cuda12.1-py3.10-gcc9-sm86 / test (dynamic_inductor_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh) (matched linux rule in flaky-rules.json)
  no space left on device
• inductor-periodic / cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (aot_eager_torchbench, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh) (matched linux rule in flaky-rules.json)
  no space left on device
• inductor-periodic / cuda12.1-py3.10-gcc9-sm86-periodic-dynamo-benchmarks / test (dynamo_eager_timm, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh) (matched linux rule in flaky-rules.json)
  no space left on device

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_huggingface_perf, 1, 3, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_huggingface_perf, 2, 3, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_huggingface_perf, 3, 3, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_timm_perf, 1, 5, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_timm_perf, 2, 5, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_timm_perf, 3, 5, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_timm_perf, 4, 5, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_timm_perf, 5, 5, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_torchbench_perf, 1, 4, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_torchbench_perf, 2, 4, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_torchbench_perf, 3, 4, linux.gcp.a100.large) (gh) (trunk failure)
• inductor-A100-perf-nightly / cuda12.1-py3.10-gcc9-sm80 / test (inductor_torchbench_perf, 4, 4, linux.gcp.a100.large) (gh) (trunk failure)

This comment was automatically generated by Dr. CI and updates every 15 minutes.