Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tailor default memory to dataset #37

Open
robertdstein opened this issue Mar 24, 2021 · 1 comment
Open

tailor default memory to dataset #37

robertdstein opened this issue Mar 24, 2021 · 1 comment
Labels
enhancement New feature or request wish list Desireable but not urgent

Comments

@robertdstein
Copy link
Member

robertdstein commented Mar 24, 2021

Is your feature request related to a problem? Please describe.
I'm always frustrated when I start a job on the desy cluster, then it dies because the memory requested is insufficient. This is not a hard problem, to first order it scales with the size of the MC.

Describe the solution you'd like
A method to adjust the default memory request depending on the dataset MC. Maybe by checking the dataset MC file size without loading?

Describe alternatives you've considered
Leave it as is. It's not too annoying, you figure it out manually once per analysis.

@robertdstein robertdstein added enhancement New feature or request wish list Desireable but not urgent labels Mar 24, 2021
@mlincett
Copy link
Collaborator

Is it correct to expect a memory consumption of (MC size) * (number of seasons) * (number of cores)?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request wish list Desireable but not urgent
Projects
None yet
Development

No branches or pull requests

2 participants