periodic: stop running dl3 and edsr on the portable backend

[shoumikhin]

Fixes #21692.

What is broken

The scheduled periodic workflow always concludes as cancelled, even when everything real about the commit is fine.

Why it is broken

Two jobs in that workflow never finish:

• test-models-linux-basic (cmake, dl3, portable, linux.4xlarge.memory, 90)
• test-models-linux-basic (cmake, edsr, portable, linux.2xlarge, 90)

Both hit the 90 minute job limit on every run since at least 2026-08-03 and are killed by GitHub. A job killed by the timeout reports cancelled, and one cancelled job makes the whole workflow read as cancelled.

In a recent periodic run these two were the only non-successes out of 59 jobs. The xnnpack variants of the same two models finished in about ten minutes each.

So today this costs about nine runner hours a day (periodic runs three times a day) and produces no result either way, while also hiding whether the rest of the periodic run was healthy.

The fix

Stop gathering the portable variants of dl3 and edsr.

gather_test_models.py already has two filters: one by event and one by target OS. Neither can express "this model on this backend", so this adds a third one, model_should_run_on_backend, in the same style as the existing yolo26 skip.

Coverage impact is small: dl3 and edsr are still tested through their xnnpack variants, and the portable path is still tested by every other model in the matrix.

Not fixed here

Why portable export of these two got so slow. A dl3 log shows an 81 minute silent gap after the runner starts plus memory pressure warnings, so raising the timeout would not be honest. #21692 tracks the real investigation, and the skip should be removed once that is done.

How this was verified

gather_test_models.py was run directly, with and without the change, for every
event and target OS the workflows actually use, and the emitted matrices were
compared:

event	target OS	jobs before	jobs after
pull_request	linux	6	6
pull_request	macos	4	4
push	linux	52	52
push	macos	50	50
schedule	linux	58	56
schedule	macos	56	54

The pull_request and push matrices are byte for byte identical, so the pull
request and trunk signal is untouched. The only entries missing from schedule
are dl3 / portable and edsr / portable. The xnnpack-quantization-delegation
variants of both models are still there, so neither model loses coverage.

periodic.yml is the only workflow that calls this script, so nothing else is
affected.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21693

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 52 Cancelled Jobs, 2 Unrelated Failures

As of commit 09fd0ee with merge base fb5eedc ():

CANCELLED JOBS - The following jobs were cancelled. Please retry:

• periodic / test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, add_mul, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, add_mul, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, add, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, add, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, conv1d, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, deep_autoencoder, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, deit_tiny, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, ds_cnn, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, efficient_sam, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, emformer_join, portable, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, emformer_transcribe, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, ic3, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, ic3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, ic4, portable, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, ic4, xnnpack-quantization-delegation, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, linear, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, linear, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, llama, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, llama2, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, llama2, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, llama3_2_vision_encoder, portable, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, lstm, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, mobilebert, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, mobilebert, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, mobilenet_v1_025, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, mul, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, mv2_untrained, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, mv2, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, mv2, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, phi_4_mini, portable, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, qwen2_5_1_5b, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, qwen3, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, resnet18, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, resnet18, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, resnet50, portable, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, resnet50, xnnpack-quantization-delegation, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, resnet8, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, sdpa, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, smollm2, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, smolvlm, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, softmax, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, w2l, portable, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, w2l, xnnpack-quantization-delegation, linux.4xlarge.memory, 90) / linux-job (gh)
• periodic / test-models-linux (cmake, whisper, portable, linux.2xlarge, 90) / linux-job (gh)

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• pull / unittest-buck / macos / macos-job (gh) (detected as infra flaky with no log or failing log classifier)
• trunk / test-models-macos-cpu (vit, xnnpack-quantization-delegation) / macos-job (gh) (detected as infra flaky with no log or failing log classifier)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[Copilot]

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[Copilot]

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

[Copilot]

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.