Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Csi resizer oom killed #1774

Open
marcinpro1 opened this issue Nov 21, 2024 · 3 comments
Open

Csi resizer oom killed #1774

marcinpro1 opened this issue Nov 21, 2024 · 3 comments

Comments

@marcinpro1
Copy link

marcinpro1 commented Nov 21, 2024

Csi resizer getting oom killer, no matter how much memory i shove into the container.

No valuable information in log.

Maybe linked with this? kubernetes-sigs/aws-ebs-csi-driver#1248

Would like to now if i its necessary for this container to work if I won't use disk resize.
Also is there anywhere I should look for more details about this issue in my cluster?

@marcinpro1 marcinpro1 changed the title Csi resizer oom killer Csi resizer oom killed Nov 21, 2024
@tiagolobocastro
Copy link
Contributor

Would you be able to update the log to trace? This can be done by updating helm vars:
--set csi.node.logLevel=trace
And then reproduce again and share a support bundle here? https://openebs.io/docs/user-guides/replicated-storage-user-guide/replicated-pv-mayastor/advanced-operations/supportability

@marcinpro1
Copy link
Author

Here you go:
openebs_dump.tar.gz
some things were redacted

@tiagolobocastro
Copy link
Contributor

Would like to now if i its necessary for this container to work if I won't use disk resize.

Not sure, I'd say probably not, but since we are exposing resize feature will this cause an issue? You could try removing the csi-resize sidecar and see if that works.

If so would be open for adding a helm var to enable/disable the resize... however
as per the bug which you have mentioned it seems if online resizing is supported (which it is) we should be setting --handle-volume-inuse-error=false otherwise the resizer is watching pods which consumes memory.
This should fix the issue for everyone without having to modify anything.

Would you be willing to raise a PR for that?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants