Add support for nightly reference tests #8715
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Description
This is still a work in progress.
repo
,workflow
,admin:repo_hook
(not sure these are actually necessary, but it's what I did)GITHUB_TOKEN
.export GITHUB_TOKEN="ghp_..."
line to my~/.zshrc
file.NIGHTLY=true ./gradlew expandRefTests
Next steps:
Add a scheduled CI test that runs at 6am UTC. This is 4 hours after the reference tests are generated. Normally, it takes about 3.5 hours for the test generators to finish.
Notes:
It would have been slightly easier to use
gh
(GitHub's CLI tool) in a CI test, but I think doing it with Gradle is the better approach for Teku. Easier to maintain and works better with the dev flow.I tried to convert the
NIGHTLY=true
environment variable to a--nightly
flag, but it was too difficult & not worth it the headache. I defined my own task with an option flag but the problem was calling the task from other tasks.Documentation
doc-change-required
label to this PR if updates are required.Changelog