[8.x](backport #5956) [CI] Buildkite integration tests: Run integration tests on ARM

[mergify]

What does this PR do?

Enhances the buildkite tests pipeline by ARM tests. It uses the prebuilt Ubuntu 24.04 ARM image
Runs integration test groups separately. Allows independent reruns.
Tested here: Example build.

Note: It doesn't replace current integration tests. The new buildkite pipeline is not triggered by GitHub events

Why is it important?

We have to test elastic agent on ARM architecture

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in ./changelog/fragments using the changelog tool
• I have added an integration test or an E2E test

Disruptive User Impact

How to test this PR locally

Related issues

• Closes https://github.com/elastic/ingest-dev/issues/4217
• Relates [Elastic Agent] Add ability to debug a composable provider #123
• Requires [Elastic Agent] Add ability to debug a composable provider #123
• Superseds [Elastic Agent] Add ability to debug a composable provider #123

Questions to ask yourself

• How are we going to support this in production?
• How are we going to measure its adoption?
• How are we going to debug this?
• What are the metrics I should take care of?
• ...

---

This is an automatic backport of pull request #5956 done by [Mergify](https://mergify.com).

[mergify]

Cherry-pick of c01636e has failed:

On branch mergify/bp/8.x/pr-5956
Your branch is up to date with 'origin/8.x'.

You are currently cherry-picking commit c01636e738.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	modified:   .buildkite/bk.integration.pipeline.yml
	modified:   .buildkite/scripts/steps/ess_start.sh
	modified:   .buildkite/scripts/steps/integration_tests_tf_sudo.sh
	modified:   test_infra/ess/deployment.tf

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   .buildkite/scripts/sudo-integration-tests.sh

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarQube