Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rework Budgeting #56

Draft
wants to merge 14 commits into
base: master
Choose a base branch
from
Draft

Rework Budgeting #56

wants to merge 14 commits into from

Conversation

sjperkins
Copy link
Collaborator

Closes #55

The idea here is that we should establish a basic number of visibilities that exercise a CPU core for, say a second, and use that as a baseline for memory budgeting across the cores on a CPU, rather than trying to make the number of visibilities in a chunk as big as possible.

  • Tests added / passed

    $ py.test --flake8 -v -s .

    If the flake8 tests fail, the quickest way to correct
    this is to run autopep8 and then flake8
    to fix the remaining issues.

    $ pip install -U autopep8 flake8
    $ autopep8 -r -i .
    $ flake8 .
    

@sjperkins sjperkins marked this pull request as draft April 6, 2023 17:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Crystalball budgets too many rows per chunk when system has a lot of memory
1 participant