Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(backend) Migrated the Persistence Agent controller to use controller-runtime #11582

Draft
wants to merge 15 commits into
base: master
Choose a base branch
from

Conversation

chahatsagarmain
Copy link
Contributor

@chahatsagarmain chahatsagarmain commented Feb 2, 2025

Description of your changes:

Checklist:

Signed-off-by: chahatsagarmain <[email protected]>
Signed-off-by: chahatsagarmain <[email protected]>
Signed-off-by: chahatsagarmain <[email protected]>
Signed-off-by: chahatsagarmain <[email protected]>
Signed-off-by: chahatsagarmain <[email protected]>
Copy link

Hi @chahatsagarmain. Thanks for your PR.

I'm waiting for a kubeflow member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@chahatsagarmain
Copy link
Contributor Author

@mprahl can you review this ?

@mprahl
Copy link
Contributor

mprahl commented Feb 3, 2025

@mprahl can you review this ?

Thanks for the PR! Once the CI is passing I'll take a look, unless you have a specific question.

@chahatsagarmain
Copy link
Contributor Author

@mprahl The CI was passing on my forked repo but seems to fail here (Create kfp cluster specifically)

@mprahl
Copy link
Contributor

mprahl commented Feb 3, 2025

@mprahl The CI was passing on my forked repo but seems to fail here (Create kfp cluster specifically)

Could you please force push (e.g. amend the commit message and force push) to restart the CI? I don't have access to restart the jobs.

Signed-off-by: chahatsagarmain <[email protected]>
@mprahl
Copy link
Contributor

mprahl commented Feb 4, 2025

The logs in the failed CI shows:

2025-02-04 08:20:06,955 - INFO - ---- Pod kubeflow/ml-pipeline-persistenceagent-77596f6678-ln59f logs ----
persistence_agent flag redefined: kubeconfig
panic: persistence_agent flag redefined: kubeconfig

goroutine 1 [running]:
flag.(*FlagSet).Var(0xc0001f20e0, {0x2687438, 0x39d49d0}, {0x2310f9e, 0xa}, {0x237794b, 0x36})
	/usr/local/go/src/flag/flag.go:1028 +0x37d
flag.StringVar(...)
	/usr/local/go/src/flag/flag.go:885
main.init.0()
	/go/src/github.com/kubeflow/pipelines/backend/src/agent/persistence/main.go:153 +0x74

Signed-off-by: chahatsagarmain <[email protected]>
Signed-off-by: chahatsagarmain <[email protected]>
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign rimolive for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Signed-off-by: chahatsagarmain <[email protected]>
@mprahl
Copy link
Contributor

mprahl commented Feb 7, 2025

@chahatsagarmain , I think the issue is that the code change is now importing the Scheduled Workflow code, and both the Persistence Agent and Scheduled Workflow Go packages have init functions with some of the same flags.

Two options come to mind:

  1. Rename those init functions so that they aren't called on import of the Go package, and explicitly call those functions in the main functions of each controller.
  2. Move the common code of each controller to a separate package.

Signed-off-by: chahatsagarmain <[email protected]>
Signed-off-by: chahatsagarmain <[email protected]>
Signed-off-by: chahatsagarmain <[email protected]>
Signed-off-by: chahatsagarmain <[email protected]>
Signed-off-by: chahatsagarmain <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: In Review
Development

Successfully merging this pull request may close these issues.

chore(Persistence Agent): Migrate the Persistence Agent controller to use controller-runtime
2 participants