-
Notifications
You must be signed in to change notification settings - Fork 612
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fast failing test in ci #1666
Fast failing test in ci #1666
Conversation
with: | ||
python-version: 3.5 | ||
- uses: actions/checkout@v2 | ||
- run: pip install -r tools/install_deps/tensorflow-cpu.txt -r tools/install_deps/pytest.txt |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Any speedup caching pip packages? https://github.com/actions/cache/blob/master/examples.md#simple-example
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I tried, but I removed it in 0083239 because we didn't get any speed benefits.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Have you tried another build After the cache build?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, you can take a look for yourself since the build logs are public for each commit. If I missed something, please let me know.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.. pytest in the resource_loader is not ideal IMO, but there's significant speed up and import looks well guarded
* Added a pytest option to skip the loading of custom ops. * Added a ci run for python-only tests. * Fix the usage of load_op_library. * Revert "Fix the usage of load_op_library." This reverts commit 94db295. * Fixture is executed after collection. * Removed assert False. * Try running on macos for speed. * Fix path. * Run on ubuntu directly. * Add caching for pip. * Indent. * Better wording. * Remove the cache because we don't get any benefits.
Related to #1655
So of course this doesn't make our CI any faster, but it provides fast feedback for contributors. With this new test, we catch most of the errors quickly since many changes are related to python-only code. The test runs in 4m and 20s, much faster than the 11m and 25s needed to run our fastest test (macos).
Some ressources: