test: integration tests for docker-compose UM #2812

danielskinstad · 2025-11-24T19:58:04Z

Ticket: MEN-8871

mender-test-bot · 2025-11-24T19:58:16Z

@danielskinstad, start a full integration test pipeline with:

mentioning me and start integration pipeline

my commands and options

You can prevent me from automatically starting CI pipelines:

if your pull request title starts with "[NoCI] ..."

You can trigger a client pipeline on multiple prs with:

mentioning me and start client pipeline --pr mender/127 --pr mender-connect/255

You can trigger GitHub->GitLab branch sync with:

mentioning me and sync

You can cherry pick to a given branch or branches with:

mentioning me and:

 cherry-pick to:
 * 1.0.x
 * 2.0.x

lluiscampos

Given the current state of this test framework, your new tests is pretty good. I like a lot that we are improving the Python code itself, for example the dataclass and the contextmanager. Thank you.

See comments below. I didn't find anything explicit to block the PR on, but I would appreciate some discussions before final approval.

.env

docker-compose.client.virtualization.yml

tests/run.sh

tests/tests/test_docker_compose.py

lluiscampos

The tests look pretty decent now. Thank you.

lluiscampos · 2025-11-27T11:02:48Z

tests/tests/test_docker_compose.py

+        tag_pattern = re.compile(r"^\d+\.\d+\.\d+$")
+        version = os.environ.get("MENDER_CONTAINER_MODULES_VERSION", "main")
+
+        base_url = "https://raw.githubusercontent.com/mendersoftware/mender-container-modules/refs"
+        file_path = "src/gen_docker-compose"
+
+        if tag_pattern.match(version):
+            ref_path = f"tags/{version}"
+        elif version.startswith("pull/"):
+            ref_path = version
+        else:
+            ref_path = f"heads/{version}"
+
+        url = f"{base_url}/{ref_path}/{file_path}"
+
+        subprocess.check_call(
+            ["curl", "--fail", "--output", script_path, url,]
+        )
+        os.chmod(script_path, 0o755)


Much of this we may want to reuse in the future. Just let's keep it in mind to refactor when needed.

danielskinstad · 2025-11-28T08:54:19Z

@mender-test-bot start integration pipeline

mender-test-bot · 2025-11-28T08:54:38Z

Hello 😺 I created a pipeline for you here: Pipeline-2184598952

Build Configuration Matrix

Key	Value
INTEGRATION_REV	pull/2812/head
RUN_TESTS_FULL_INTEGRATION	true

danielskinstad · 2025-11-28T14:36:26Z

@mender-test-bot start integration pipeline

mender-test-bot · 2025-11-28T14:36:42Z

There was an error while syncing branches: POST https://gitlab.com/api/v4/projects/Northern%2Etech%2FMender%2Fintegration/protected_branches: 409 {message: Protected branch 'pr_2812_protected' already exists} returned error: POST https://gitlab.com/api/v4/projects/Northern%2Etech%2FMender%2Fintegration/protected_branches: 409 {message: Protected branch 'pr_2812_protected' already exists} returned error: POST https://gitlab.com/api/v4/projects/Northern%2Etech%2FMender%2Fintegration/protected_branches: 409 {message: Protected branch 'pr_2812_protected' already exists} returned error: POST https://gitlab.com/api/v4/projects/Northern%2Etech%2FMender%2Fintegration/protected_branches: 409 {message: Protected branch 'pr_2812_protected' already exists}

danielskinstad · 2025-11-28T14:38:05Z

@mender-test-bot start integration pipeline

mender-test-bot · 2025-11-28T14:38:22Z

There was an error while syncing branches: POST https://gitlab.com/api/v4/projects/Northern%2Etech%2FMender%2Fintegration/protected_branches: 409 {message: Protected branch 'pr_2812_protected' already exists} returned error: POST https://gitlab.com/api/v4/projects/Northern%2Etech%2FMender%2Fintegration/protected_branches: 409 {message: Protected branch 'pr_2812_protected' already exists} returned error: POST https://gitlab.com/api/v4/projects/Northern%2Etech%2FMender%2Fintegration/protected_branches: 409 {message: Protected branch 'pr_2812_protected' already exists} returned error: POST https://gitlab.com/api/v4/projects/Northern%2Etech%2FMender%2Fintegration/protected_branches: 409 {message: Protected branch 'pr_2812_protected' already exists}

danielskinstad · 2025-11-28T14:39:48Z

@mender-test-bot start integration pipeline

mender-test-bot · 2025-11-28T14:40:07Z

Hello 😺 I created a pipeline for you here: Pipeline-2185272210

Build Configuration Matrix

Key	Value
INTEGRATION_REV	pull/2812/head
RUN_TESTS_FULL_INTEGRATION	true

danielskinstad · 2025-12-01T08:43:42Z

@mender-test-bot start integration pipeline

mender-test-bot · 2025-12-01T08:43:53Z

There was an error while syncing branches: [push -f -o ci.skip --set-upstream gitlab pr_2812_protected] returned error: remote: GitLab: You are not allowed to force push code to a protected branch on this project.
To gitlab.com:Northern.tech/Mender/integration
! [remote rejected] pr_2812_protected -> pr_2812_protected (pre-receive hook declined)
error: failed to push some refs to 'gitlab.com:Northern.tech/Mender/integration'
: exit status 1 returned error: There was an error syncing branches: [push -f -o ci.skip --set-upstream gitlab pr_2812_protected] returned error: remote: GitLab: You are not allowed to force push code to a protected branch on this project.
To gitlab.com:Northern.tech/Mender/integration
! [remote rejected] pr_2812_protected -> pr_2812_protected (pre-receive hook declined)
error: failed to push some refs to 'gitlab.com:Northern.tech/Mender/integration'
: exit status 1

danielskinstad · 2025-12-01T08:46:03Z

@mender-test-bot start integration pipeline

mender-test-bot · 2025-12-01T08:46:23Z

Hello 😺 I created a pipeline for you here: Pipeline-2188556685

Build Configuration Matrix

Key	Value
INTEGRATION_REV	pull/2812/head
RUN_TESTS_FULL_INTEGRATION	true

Ticket: MEN-8871 Signed-off-by: Daniel Skinstad Drabitzius <[email protected]>

danielskinstad · 2025-12-01T09:44:47Z

@mender-test-bot start integration pipeline

mender-test-bot · 2025-12-01T09:44:59Z

There was an error while syncing branches: [push -f -o ci.skip --set-upstream gitlab pr_2812_protected] returned error: remote: GitLab: You are not allowed to force push code to a protected branch on this project.
To gitlab.com:Northern.tech/Mender/integration
! [remote rejected] pr_2812_protected -> pr_2812_protected (pre-receive hook declined)
error: failed to push some refs to 'gitlab.com:Northern.tech/Mender/integration'
: exit status 1 returned error: There was an error syncing branches: [push -f -o ci.skip --set-upstream gitlab pr_2812_protected] returned error: remote: GitLab: You are not allowed to force push code to a protected branch on this project.
To gitlab.com:Northern.tech/Mender/integration
! [remote rejected] pr_2812_protected -> pr_2812_protected (pre-receive hook declined)
error: failed to push some refs to 'gitlab.com:Northern.tech/Mender/integration'
: exit status 1

danielskinstad · 2025-12-01T09:47:13Z

@mender-test-bot start integration pipeline

mender-test-bot · 2025-12-01T09:47:32Z

Hello 😺 I created a pipeline for you here: Pipeline-2188673063

Build Configuration Matrix

Key	Value
INTEGRATION_REV	pull/2812/head
RUN_TESTS_FULL_INTEGRATION	true

danielskinstad requested a review from a team as a code owner November 24, 2025 19:58

danielskinstad force-pushed the docker-compose-tests branch from 278e78e to a4f7f5a Compare November 25, 2025 08:17

lluiscampos reviewed Nov 25, 2025

View reviewed changes

danielskinstad force-pushed the docker-compose-tests branch from a4f7f5a to 6b993f6 Compare November 26, 2025 14:46

danielskinstad requested a review from lluiscampos November 26, 2025 16:27

lluiscampos approved these changes Nov 27, 2025

View reviewed changes

danielskinstad force-pushed the docker-compose-tests branch from 6b993f6 to 264f17a Compare December 1, 2025 08:43

test: integration tests for docker-compose UM

ca1e912

Ticket: MEN-8871 Signed-off-by: Daniel Skinstad Drabitzius <[email protected]>

danielskinstad force-pushed the docker-compose-tests branch from 264f17a to ca1e912 Compare December 1, 2025 09:04

danielskinstad merged commit f5672a7 into mendersoftware:master Dec 1, 2025
2 checks passed

danielskinstad deleted the docker-compose-tests branch December 1, 2025 10:48

test: integration tests for docker-compose UM #2812

test: integration tests for docker-compose UM #2812

Uh oh!

Conversation

danielskinstad commented Nov 24, 2025

Uh oh!

mender-test-bot commented Nov 24, 2025

Uh oh!

lluiscampos left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

lluiscampos left a comment

Choose a reason for hiding this comment

Uh oh!

lluiscampos Nov 27, 2025

Choose a reason for hiding this comment

Uh oh!

danielskinstad commented Nov 28, 2025

Uh oh!

mender-test-bot commented Nov 28, 2025

Uh oh!

danielskinstad commented Nov 28, 2025

Uh oh!

mender-test-bot commented Nov 28, 2025

Uh oh!

danielskinstad commented Nov 28, 2025

Uh oh!

mender-test-bot commented Nov 28, 2025

Uh oh!

danielskinstad commented Nov 28, 2025

Uh oh!

mender-test-bot commented Nov 28, 2025

Uh oh!

danielskinstad commented Dec 1, 2025

Uh oh!

mender-test-bot commented Dec 1, 2025

Uh oh!

danielskinstad commented Dec 1, 2025

Uh oh!

mender-test-bot commented Dec 1, 2025

Uh oh!

danielskinstad commented Dec 1, 2025

Uh oh!

mender-test-bot commented Dec 1, 2025

Uh oh!

danielskinstad commented Dec 1, 2025

Uh oh!

mender-test-bot commented Dec 1, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants