Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

buildbot runner image is incomplete #4

Open
xjia1 opened this issue Oct 9, 2023 · 4 comments
Open

buildbot runner image is incomplete #4

xjia1 opened this issue Oct 9, 2023 · 4 comments
Assignees
Labels
bug Something isn't working

Comments

@xjia1
Copy link
Collaborator

xjia1 commented Oct 9, 2023

The existing list seems incomplete because it's missing git. Need to revise based on https://github.com/actions/runner-images/blob/main/images/linux/Ubuntu2204-Readme.md

@xjia1
Copy link
Collaborator Author

xjia1 commented Oct 9, 2023

https://github.com/nstests/bjtest/actions/runs/6462178590/job/17543436621

2023-10-09T22:39:26.7097534Z In file included from ./boost/python/detail/prefix.hpp:13,
2023-10-09T22:39:26.7098284Z                  from ./boost/python/converter/registrations.hpp:8,
2023-10-09T22:39:26.7098841Z                  from libs/python/src/object/function_doc_signature.cpp:9:
2023-10-09T22:39:26.7099274Z ./boost/python/detail/wrap_python.hpp:57:11: fatal error: pyconfig.h: No such file or directory
2023-10-09T22:39:26.7099653Z    57 | # include <pyconfig.h>
2023-10-09T22:39:26.7099900Z       |           ^~~~~~~~~~~~
2023-10-09T22:39:26.7100148Z compilation terminated.
sudo apt install python3-dev

@xjia1
Copy link
Collaborator Author

xjia1 commented Oct 17, 2023

This is already fixed in the dimerun image where we use the official runner image packer build scripts to install all dependencies. Not sure if it's applicable to a docker image.

@xjia1
Copy link
Collaborator Author

xjia1 commented Nov 2, 2023

Need to rethink this because the github image is very large.

@xjia1
Copy link
Collaborator Author

xjia1 commented Nov 10, 2023

I'd like to see if it is feasible to just use the official runner image from GitHub Actions. Last time I checked it used about 35 GiB of disk space. Not sure about the size after compression.

Somethings we should try:

  • Install the GHA runner image as a container image, not VM
  • Check the size of the container image and if it's feasible to distribute it via GHCR
  • Remove components from the GHA runner image to see if we can reduce the size to a more reasonable value without losing too many features. The target size is mostly dependent on how much disk space we get from the various cloud providers using our recommended minimum configurations

@xjia1 xjia1 added the bug Something isn't working label Nov 10, 2023
@xjia1 xjia1 changed the title buildbot runner image: add git and many other packages buildbot runner image is incomplete Nov 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants