Skip to content

Arm backend: Add testing/support for Inception_v4 and w2l for Ethos-U85 #10517

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

zingo
Copy link
Collaborator

@zingo zingo commented Apr 28, 2025

Summary

Inception_v4 and w2l for Ethos-U85
Inception_v3/4, w2l and resnet18/50 for TOSA

Make it possible to override default runtime timeout per test

This also split up GitHub testing in a few separate runners to speed up the testing as it takes longer then 60min.

Fixes #9602
This also fix #9602 where arm unittest didn't build Executorch with EXECUTORCH_BUILD_ARM_BAREMETAL enabled

Test plan

Improve the unit and model testing for Arm backend in github with this patch.

cc @digantdesai @freddan80 @per @oscarandersson8218

Inception_v4 and w2l for Ethos-U85
Inception_v3/4, w2l and resnet18/50 for TOSA

Make it possible to override default runtime timeout per test

This also split up GitHub testing in a few separate runners
to speed up the testing as it takes longer then 60min.

This also fix pytorch#9602 where arm unittest didn't build
Executorch with EXECUTORCH_BUILD_ARM_BAREMETAL enabled

Signed-off-by: Zingo Andersen <[email protected]>
Change-Id: I6e1b6ec18c450896aa4e7b5d7a37d27c4c7f879d
@zingo zingo requested a review from digantdesai as a code owner April 28, 2025 14:04
Copy link

pytorch-bot bot commented Apr 28, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/10517

Note: Links to docs will display an error until the docs builds have been completed.

⏳ 2 Pending, 2 Unrelated Failures

As of commit cceef97 with merge base 17b933f (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 28, 2025
@zingo zingo added partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm ciflow/trunk topic: not user facing labels Apr 28, 2025
@zingo
Copy link
Collaborator Author

zingo commented Apr 28, 2025

Hi @digantdesai and @mergennachin in this PR I have splitted up the Arm jobs into a few more runners. Aim is to not take such huge amount of time as in the (currently) 3 jobs. E.g. now they take around 1h before this patch.

@zingo zingo requested a review from mergennachin April 28, 2025 21:12
@zingo zingo merged commit e5874fa into pytorch:main Apr 29, 2025
261 of 263 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm topic: not user facing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

ARM baremetal tests are not running properly
3 participants