Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: use more CPUs for building #12442

Closed
wants to merge 1 commit into from
Closed

CI: use more CPUs for building #12442

wants to merge 1 commit into from

Conversation

SpecLad
Copy link
Contributor

@SpecLad SpecLad commented Jun 4, 2024

The standard GitHub runners have 3 to 4 CPUs, depending on the OS: https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners/about-github-hosted-runners#standard-github-hosted-runners-for-public-repositories. Increase the number of Make jobs to utilize those CPUs better.

@SpecLad SpecLad marked this pull request as ready for review June 4, 2024 22:12
@rb6502
Copy link
Contributor

rb6502 commented Jun 5, 2024

The change itself is reasonable, but my understanding is that there are GitHub-imposed resource limits that we potentially could run into and that's why the settings are low right now.

@SpecLad
Copy link
Contributor Author

SpecLad commented Jun 5, 2024

I'm not aware of any additional limits. You get the runner that you get, and it's up to you how to use it.

and that's why the settings are low right now.

I assumed that they are low because they were configured before GitHub started using 4-core runners (which is this year: https://github.blog/2024-01-17-github-hosted-runners-double-the-power-for-open-source/).

@rb6502
Copy link
Contributor

rb6502 commented Jun 5, 2024

https://docs.mamedev.org/contributing/index.html says we've had contributors banned from GitHub for using "too much" CPU and GitHub would not define what "too much" is. I don't remember the specific details (@cuavas might) but apparently it's a thing.

@plaes
Copy link
Contributor

plaes commented Jun 26, 2024

Proper way to do that would be make -j$(nproc).

@cuavas
Copy link
Member

cuavas commented Jun 26, 2024

I’d be somewhat concerned about that with limited memory. A -j5 build on a fairly minimal Linux system with 6GB RAM hits swap pretty hard at two points whether you use GCC or clang. The macOS runners only have 7GB RAM, so I wouldn’t want to sail too close to the wind.

@cuavas
Copy link
Member

cuavas commented Jun 26, 2024

https://docs.mamedev.org/contributing/index.html says we've had contributors banned from GitHub for using "too much" CPU and GitHub would not define what "too much" is. I don't remember the specific details (@cuavas might) but apparently it's a thing.

Correct, @0kmg was banned from GitHub actions.

@SpecLad SpecLad closed this Jun 30, 2024
@angelosa angelosa mentioned this pull request Sep 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants