Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] refactor vertical-pod-autoscaler-operator tests for operator-sdk upgrade #55425

Closed
wants to merge 3 commits into from

Conversation

maxcao13
Copy link
Contributor

@maxcao13 maxcao13 commented Aug 9, 2024

Ignore for now, just checking to see if it works against my branch.

This is so that we can fix tests that have to migrated to the operator-sdk upgrade in the VPA-operator sooner than later since a lot has changed in the repo.

The first commit is to make sure that images get pulled correctly and simple tests (go vet, fmt ,etc. get tested correctly).

Further commits will test the e2e tests that require a cluster.

Which should let us get instant feedback on test changes when we merge VPA upgrade PR instead of having to change there, then come back here and change it.

PR in question here: openshift/vertical-pod-autoscaler-operator#169

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Aug 9, 2024
Copy link
Contributor

openshift-ci bot commented Aug 9, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: maxcao13

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 9, 2024
@maxcao13
Copy link
Contributor Author

maxcao13 commented Aug 9, 2024

/pj-rehearse

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci-robot
Copy link
Contributor

@maxcao13, pj-rehearse: unable to set up jobs ERROR:

ci-operator config file openshift-vertical-pod-autoscaler-operator-vpa-operator-upgrade.yaml was not found

If the problem persists, please contact Test Platform.

@maxcao13
Copy link
Contributor Author

maxcao13 commented Aug 9, 2024

/pj-rehearse

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

maxcao13 commented Aug 9, 2024

/pj-rehearse

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

maxcao13 commented Aug 9, 2024

Fixed some vendoring issue in upgrade branch, and used a golangci-lint image to run the lint test so hopefully these non e2e tests will work now.

@maxcao13
Copy link
Contributor Author

maxcao13 commented Aug 9, 2024

/pj-rehearse more

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

maxcao13 commented Aug 9, 2024

/pj-rehearse more

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

/pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-unit pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-manifest-diff

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

/pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-unit pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-manifest-diff

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

/pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-unit

@maxcao13
Copy link
Contributor Author

I'm adding the scorecard test suite to the CI as well. And I will also retest all the rehearsals just as a sanity check. I expect the lint check to fail because of a deprecation warning.

/pj-rehearse max

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

/pj-rehearse max

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci-robot
Copy link
Contributor

@maxcao13, pj-rehearse: unable to determine affected jobs. This could be due to a branch that needs to be rebased. ERROR:

could not load configuration from candidate revision of release repo: failed to load ci-operator configuration from release repo: invalid ci-operator config: invalid configuration: releases.multi-latest.channel: must be one of candidate, fast, stable
Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse abort to abort all active rehearsals

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@openshift-ci-robot
Copy link
Contributor

@maxcao13, pj-rehearse: unable to determine affected jobs ERROR:

could not load configuration from candidate revision of release repo: failed to load ci-operator configuration from release repo: invalid ci-operator config: invalid configuration: releases.multi-latest.channel: must be one of candidate, fast, stable

If the problem persists, please contact Test Platform.

@maxcao13
Copy link
Contributor Author

/pj-rehearse max

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

/pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-scorecard pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-unit

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

/pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-scorecard

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@maxcao13
Copy link
Contributor Author

/pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-scorecard

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci-robot
Copy link
Contributor

[REHEARSALNOTIFIER]
@maxcao13: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-scorecard maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-e2e-aws-olm maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-e2e-aws-operator maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-gofmt maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-lint maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-govet maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-images maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-manifest-diff maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-security maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-unit maxcao13/vertical-pod-autoscaler-operator presubmit Presubmit changed
Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse abort to abort all active rehearsals

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@maxcao13
Copy link
Contributor Author

/pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-scorecard

@openshift-ci-robot
Copy link
Contributor

@maxcao13: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

Copy link
Contributor

openshift-ci bot commented Aug 16, 2024

@maxcao13: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/rehearse/maxcao13/vertical-pod-autoscaler-operator/vpa-operator-upgrade/manifest-diff 070b57a link unknown /pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-vpa-operator-upgrade-manifest-diff
ci/rehearse/maxcao13/vertical-pod-autoscaler-operator/vpa-operator-upgrade/security 070b57a link unknown /pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-vpa-operator-upgrade-security
ci/rehearse/maxcao13/vertical-pod-autoscaler-operator/operator-sdk-upgrade-v2.1/golint e37f65b link unknown /pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-golint
ci/rehearse/maxcao13/vertical-pod-autoscaler-operator/vpa-operator-upgrade/golint 070b57a link unknown /pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-vpa-operator-upgrade-golint
ci/rehearse/maxcao13/vertical-pod-autoscaler-operator/vpa-operator-upgrade/govet 070b57a link unknown /pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-vpa-operator-upgrade-govet
ci/rehearse/maxcao13/vertical-pod-autoscaler-operator/vpa-operator-upgrade/images 070b57a link unknown /pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-vpa-operator-upgrade-images
ci/prow/ordered-prow-config 65383a3 link true /test ordered-prow-config
ci/prow/ci-operator-config 65383a3 link true /test ci-operator-config
ci/rehearse/maxcao13/vertical-pod-autoscaler-operator/operator-sdk-upgrade-v2.1/lint 2538546 link unknown /pj-rehearse pull-ci-maxcao13-vertical-pod-autoscaler-operator-operator-sdk-upgrade-v2.1-lint
ci/prow/prow-config-semantics 65383a3 link true /test prow-config-semantics
ci/prow/owners 65383a3 link true /test owners
ci/prow/generated-config 65383a3 link true /test generated-config
ci/prow/check-gh-automation 65383a3 link true /test check-gh-automation
ci/prow/config 65383a3 link true /test config

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@maxcao13
Copy link
Contributor Author

Scorecard tests finally pass as I was finally able to figure out how to request a hypershift cluster to run it on (which should reduce time and cost to spin up). I'm assuming it took so long because it was a rehearsal which had to build everything on its own.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants