Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(ci,docker): disable var-lib-apt cache #5004

Merged
merged 3 commits into from
Jul 18, 2024
Merged

feat(ci,docker): disable var-lib-apt cache #5004

merged 3 commits into from
Jul 18, 2024

Conversation

youtalk
Copy link
Member

@youtalk youtalk commented Jul 17, 2024

Description

This PR fixes the issue #5002 (comment).

Oh, it was failed due to another reason... From my several months experience, docker/bake-action, which is used in docker-build-and-push workflow, tends to cause more problems than docker/build-push-action, which is used in health-check workflow. I will invalidate the relevant cache.

https://github.com/autowarefoundation/autoware/actions/runs/9974064666/job/27560776559#step:5:10093

105.1 fatal: [localhost]: FAILED! => {"changed": false, "msg": "Failed to lock apt for exclusive operation: Failed to lock directory /var/lib/apt/lists/: E:Could not open lock file /var/lib/apt/lists/lock - open (2: No such file or directory)"}

In the case of mount=type=cache,sharing=locked, it should be exclusive even if built in parallel. However, it seems that when using docker/bake-action, the exclusive process occasionally fails.

https://github.com/moby/buildkit/blob/master/frontend/dockerfile/docs/reference.md?utm_source=pocket_reader#run---mounttypecache

Tests performed

https://github.com/autowarefoundation/autoware/actions/runs/9981995778

Effects on system behavior

Not applicable.

Interface changes

Pre-review checklist for the PR author

The PR author must check the checkboxes below when creating the PR.

In-review checklist for the PR reviewers

The PR reviewers must check the checkboxes below before approval.

Post-review checklist for the PR author

The PR author must check the checkboxes below before merging.

  • There are no open discussions or they are tracked via tickets.

After all checkboxes are checked, anyone who has write access can merge the PR.

youtalk added 2 commits July 17, 2024 21:18
Signed-off-by: Yutaka Kondo <[email protected]>
Signed-off-by: Yutaka Kondo <[email protected]>
@youtalk youtalk self-assigned this Jul 17, 2024
@youtalk youtalk added type:bug Software flaws or errors. type:ci Continuous Integration (CI) processes and testing. type:containers Docker containers, containerization of components, or container orchestration. labels Jul 17, 2024
@youtalk youtalk marked this pull request as ready for review July 18, 2024 12:43
@youtalk youtalk requested a review from oguzkaganozt as a code owner July 18, 2024 12:43
@youtalk youtalk requested review from xmfcx and mitsudome-r July 18, 2024 12:43
@youtalk youtalk added the tag:run-health-check Run health-check label Jul 18, 2024
@xmfcx
Copy link
Contributor

xmfcx commented Jul 18, 2024

@youtalk
Copy link
Member Author

youtalk commented Jul 18, 2024

@xmfcx This PR is not a PR to reduce disk space. By merging the subsequent PR #5009, I've confirmed that the health-check and docker-build-and-push were success.

@xmfcx
Copy link
Contributor

xmfcx commented Jul 18, 2024

I'm merging this bypassing health-check / docker-build (cuda) (pull_request) requirement, hopefully it will be fixed soon.

@xmfcx xmfcx merged commit 8be95f8 into main Jul 18, 2024
20 of 22 checks passed
@xmfcx xmfcx deleted the disable-var-lib-apt branch July 18, 2024 21:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag:run-health-check Run health-check type:bug Software flaws or errors. type:ci Continuous Integration (CI) processes and testing. type:containers Docker containers, containerization of components, or container orchestration.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants