Headless run on buildjet runner #4414

amashianov · 2024-03-19T17:57:14Z

amashianov
Mar 19, 2024

Hey guys!

It seems as if nobody else had this problem with detox headless runs. Tried the search in this repo, in google and with perplexity.ai/github copilot chat.

Would greatly appreciate if you have any suggestions.

Trying to run detox tests on CI headlessly. Locally on macOS the test suite via same instructions works.
Everything works until the test runner tries to actually detect any element as visible(see the logs). It doesn't detect

Using github CI buildjet runners

Using this emulator runner the runner

I do run a spawned nodejs websocket api mocking process via globalSetup.

Error excerpt:
Test Failed: Waited for the root of the view hierarchy to have window focus and not request layout for 10 seconds. If you specified a non default root matcher, it may be picking a root that never takes focus. Root:

I tried to bring app to forefront via adb, doesn't seem to be the issue.

Relevant logs

/usr/bin/sh -c detox test --configuration android.emu.release -l verbose --headless --record-logs all
...
...

17:18:50.610 detox[7737] i ws-client:APP_STATUS The app seems to be idle
17:18:51.873 detox[7737] i child-process:SPAWN_STDERR s_glBindAttribLocation: bind attrib 0 name position
s_glBindAttribLocation: bind attrib 1 name color
s_glBindAttribLocation: bind attrib 2 name localCoord

17:18:52.187 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "date +\"%m-%d %T.000\""
17:18:52.209 detox[7737] i child-process:SPAWN_END /usr/local/lib/android/sdk/platform-tools/adb -s emulator-5554 shell "logcat -T \"03-19 17:18:35.000\" --pid=2724 -f /sdcard/17189766_1.log" terminated with SIGINT
17:18:52.210 detox[7737] i lifecycle Test Welcome Screen: Should have welcome screen with secret hash override [FAIL]

17:18:52.219 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 pull "/sdcard/17189766_1.log" "artifacts/android.emu.release.2024-03-19 17-18-06Z/✗ Test Welcome Screen Should have welcome screen with secret hash override/device.log"
17:18:52.244 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "rm  \"/sdcard/17189766_1.log\""
17:18:52.294 detox[7725] E ws-server connection :46289<->:38608
17:18:52.296 detox[7737] i child-process:SPAWN_END /usr/local/lib/android/sdk/platform-tools/adb -s emulator-5554 shell am instrument -w -r -e detoxServer ws://localhost:46289 -e detoxSessionId 183ed4f0-3948-d540-0da5-58fc109f620a -e colonyBaseURL aHR0cDovL2xvY2FsaG9zdDozMDAwL2NvbG9ueS9hcGkvdjEv -e jacobiBaseURL aHR0cDovL2xvY2FsaG9zdDozMDAwL2phY29iaS9hcGkvdjEv -e jacobiWSURL d3M6Ly9sb2NhbGhvc3Q6MzAwMC9qYWNvYmkvdjEv -e secretHashOverride 'b3ZlcnJpZGRlbiBzZWNyZXQgaGFzaA==' -e debug false com.formichmi.test/androidx.test.runner.AndroidJUnitRunner terminated with SIGINT
17:18:52.296 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 reverse --remove tcp:46289
FAIL e2e/tests/steps/welcomeScreen.test.ts (21.821 s)
  Test Welcome Screen
    ✕ Should have welcome screen with secret hash override (16510 ms)

  ● Test Welcome Screen › Should have welcome screen with secret hash override

    Test Failed: Waited for the root of the view hierarchy to have window focus and not request layout for 10 seconds. If you specified a non default root matcher, it may be picking a root that never takes focus. Root:
    Root{application-window-token=android.view.ViewRootImpl$W@22cdec5, window-token=android.view.ViewRootImpl$W@22cdec5, has-window-focus=false, layout-params-type=1, layout-params-string={(0,0)(fillxfill) sim={adjust=resize} ty=BASE_APPLICATION wanim=0x10302fe
      fl=LAYOUT_IN_SCREEN FULLSCREEN LAYOUT_INSET_DECOR SPLIT_TOUCH HARDWARE_ACCELERATED DRAWS_SYSTEM_BAR_BACKGROUNDS
      pfl=NO_MOVE_ANIMATION FORCE_DRAW_STATUS_BAR_BACKGROUND FIT_INSETS_CONTROLLED
      bhv=DEFAULT
      fitSides=}, decor-view-string=DecorView{id=-1, visibility=VISIBLE, width=2960, height=1848, has-focus=false, has-focusable=true, has-window-focus=false, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params={(0,0)(fillxfill) sim={adjust=resize} ty=BASE_APPLICATION wanim=0x10302fe
      fl=LAYOUT_IN_SCREEN FULLSCREEN LAYOUT_INSET_DECOR SPLIT_TOUCH HARDWARE_ACCELERATED DRAWS_SYSTEM_BAR_BACKGROUNDS
      pfl=NO_MOVE_ANIMATION FORCE_DRAW_STATUS_BAR_BACKGROUND FIT_INSETS_CONTROLLED
      bhv=DEFAULT
      fitSides=}, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=2}}

      10 |
      11 |     const welcomeMessageElem = element(by.id(testIds.welcomeMessage));
    > 12 |     await expect(welcomeMessageElem).toBeVisible();
         |                                      ^
      13 |     const welcomeMessageAttrs = await welcomeMessageElem.getAttributes();
      14 |
      15 |     if ('text' in welcomeMessageAttrs) {

      at Object.<anonymous> (e2e/tests/steps/welcomeScreen.test.ts:12:38)

Test Suites: 2 failed, 2 total
Tests:       2 failed, 2 total
Snapshots:   0 total
Time:        42.838 s
Ran all test suites.

Here's the step from github actions

      - name: Run Detox Tests
        uses: reactivecircus/android-emulator-runner@v2
        timeout-minutes: 5
        with:
          api-level: 34
          target: default
          arch: x86_64
          cores: 2
          ram-size: 2048M
          avd-name: galaxy_tab_s8_ultra
          profile: galaxy_tab_s8_ultra_hardware_profile
          force-avd-creation: false
          emulator-boot-timeout: 120 # 2min
          emulator-options: -no-window -gpu swiftshader_indirect -noaudio -no-boot-anim -camera-back none
          disable-animations: false
          pre-emulator-launch-script:
            adb start-server
            adb wait-for-device
            adb shell monkey -p com.formichmi 1
          script: |
            detox test --headless --configuration android.emu.release -l verbose --record-logs all

Full logs(if you haven't found something in excerpt above)

``` /usr/bin/sh -c detox test --configuration android.emu.release -l verbose --headless --record-logs all 17:18:06.255 detox[7725] i ws-server Detox server listening on localhost:46289... 17:18:06.265 detox[7725] B lifecycle jest --config ./e2e/jest.config.ts 17:18:09.451 detox[7737] i user Starting mock server... origin: at e2e/testSetup/globalSetup.ts:7:13 17:18:09.644 detox[7737] i user Mocking server msg: yarn run v1.22.19 $ tsx watch -r dotenv/config e2e/apisMockingServer/mockServer.ts

origin: at e2e/testSetup/globalSetup.ts:10:17
17:18:09.738 detox[7725] B ws-server connection :46289<->:53674
17:18:09.795 detox[7725] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/emulator/emulator" -list-avds --verbose
17:18:09.806 detox[7725] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/emulator/emulator" -version -no-window
17:18:09.838 detox[7725] i device Detected emulator binary version { major: 34, minor: 1, patch: 19, toString: [Function: toString] }
17:18:09.838 detox[7725] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" devices
17:18:09.841 detox[7725] i child-process:EXEC_SUCCESS List of devices attached
emulator-5554 device

17:18:09.850 detox[7725] i device:DEVICE_LOOKUP Found a matching & free device emulator-5554
17:18:09.850 detox[7725] i device settled on emulator-5554 (galaxy_tab_s8_ultra)
data: {
"id": "emulator-5554",
"adbName": "emulator-5554",
"name": "emulator-5554 (galaxy_tab_s8_ultra)"
}
17:18:09.851 detox[7725] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "getprop dev.bootcomplete"
17:18:09.864 detox[7725] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "getprop ro.build.version.sdk"
17:18:09.879 detox[7725] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "settings put global animator_duration_scale 0"
17:18:09.900 detox[7725] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "settings put global window_animation_scale 0"
17:18:09.912 detox[7725] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "settings put global transition_animation_scale 0"
17:18:09.924 detox[7725] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "dumpsys power | grep "^[ ]m[UW].=""
17:18:09.955 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/build-tools/34.0.0/aapt" dump badging "/home/runner/actions-runner/_work/formicHMI/formicHMI/android/app/build/outputs/apk/release/app-release.apk"
17:18:09.967 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "pm list packages com.formichmi"
17:18:09.983 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "pm list packages com.formichmi.test"
17:18:09.997 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "am force-stop com.formichmi"
17:18:10.017 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/build-tools/34.0.0/aapt" dump xmlstrings "/home/runner/actions-runner/_work/formicHMI/formicHMI/android/app/build/outputs/apk/release/app-release.apk" AndroidManifest.xml
17:18:10.020 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/build-tools/34.0.0/aapt" dump xmlstrings "/home/runner/actions-runner/_work/formicHMI/formicHMI/android/app/build/outputs/apk/androidTest/release/app-release-androidTest.apk" AndroidManifest.xml
17:18:10.024 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "rm -fr /data/local/tmp/detox"
17:18:10.039 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "mkdir -p /data/local/tmp/detox"
17:18:10.049 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 push "/home/runner/actions-runner/_work/formicHMI/formicHMI/android/app/build/outputs/apk/release/app-release.apk" "/data/local/tmp/detox/Application.apk"
17:18:10.157 detox[7737] i user Mocking server msg: Server running on port 3000

origin: at e2e/testSetup/globalSetup.ts:10:17
17:18:10.158 detox[7737] i user Mocking server msg: Expo hash override: undefined

17:18:52.187 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "date +"%m-%d %T.000""
17:18:52.209 detox[7737] i child-process:SPAWN_END /usr/local/lib/android/sdk/platform-tools/adb -s emulator-5554 shell "logcat -T "03-19 17:18:35.000" --pid=2724 -f /sdcard/17189766_1.log" terminated with SIGINT
17:18:52.210 detox[7737] i lifecycle Test Welcome Screen: Should have welcome screen with secret hash override [FAIL]

17:18:52.219 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 pull "/sdcard/17189766_1.log" "artifacts/android.emu.release.2024-03-19 17-18-06Z/✗ Test Welcome Screen Should have welcome screen with secret hash override/device.log"
17:18:52.244 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 shell "rm "/sdcard/17189766_1.log""
17:18:52.294 detox[7725] E ws-server connection :46289<->:38608
17:18:52.296 detox[7737] i child-process:SPAWN_END /usr/local/lib/android/sdk/platform-tools/adb -s emulator-5554 shell am instrument -w -r -e detoxServer ws://localhost:46289 -e detoxSessionId 183ed4f0-3948-d540-0da5-58fc109f620a -e colonyBaseURL aHR0cDovL2xvY2FsaG9zdDozMDAwL2NvbG9ueS9hcGkvdjEv -e jacobiBaseURL aHR0cDovL2xvY2FsaG9zdDozMDAwL2phY29iaS9hcGkvdjEv -e jacobiWSURL d3M6Ly9sb2NhbGhvc3Q6MzAwMC9qYWNvYmkvdjEv -e secretHashOverride 'b3ZlcnJpZGRlbiBzZWNyZXQgaGFzaA==' -e debug false com.formichmi.test/androidx.test.runner.AndroidJUnitRunner terminated with SIGINT
17:18:52.296 detox[7737] i child-process:EXEC_CMD "/usr/local/lib/android/sdk/platform-tools/adb" -s emulator-5554 reverse --remove tcp:46289
FAIL e2e/tests/steps/welcomeScreen.test.ts (21.821 s)
Test Welcome Screen
✕ Should have welcome screen with secret hash override (16510 ms)

● Test Welcome Screen › Should have welcome screen with secret hash override

Test Failed: Waited for the root of the view hierarchy to have window focus and not request layout for 10 seconds. If you specified a non default root matcher, it may be picking a root that never takes focus. Root:
Root{application-window-token=android.view.ViewRootImpl$W@22cdec5, window-token=android.view.ViewRootImpl$W@22cdec5, has-window-focus=false, layout-params-type=1, layout-params-string={(0,0)(fillxfill) sim={adjust=resize} ty=BASE_APPLICATION wanim=0x10302fe
  fl=LAYOUT_IN_SCREEN FULLSCREEN LAYOUT_INSET_DECOR SPLIT_TOUCH HARDWARE_ACCELERATED DRAWS_SYSTEM_BAR_BACKGROUNDS
  pfl=NO_MOVE_ANIMATION FORCE_DRAW_STATUS_BAR_BACKGROUND FIT_INSETS_CONTROLLED
  bhv=DEFAULT
  fitSides=}, decor-view-string=DecorView{id=-1, visibility=VISIBLE, width=2960, height=1848, has-focus=false, has-focusable=true, has-window-focus=false, is-clickable=false, is-enabled=true, is-focused=false, is-focusable=false, is-layout-requested=false, is-selected=false, layout-params={(0,0)(fillxfill) sim={adjust=resize} ty=BASE_APPLICATION wanim=0x10302fe
  fl=LAYOUT_IN_SCREEN FULLSCREEN LAYOUT_INSET_DECOR SPLIT_TOUCH HARDWARE_ACCELERATED DRAWS_SYSTEM_BAR_BACKGROUNDS
  pfl=NO_MOVE_ANIMATION FORCE_DRAW_STATUS_BAR_BACKGROUND FIT_INSETS_CONTROLLED
  bhv=DEFAULT
  fitSides=}, tag=null, root-is-layout-requested=false, has-input-connection=false, x=0.0, y=0.0, child-count=2}}

  10 |
  11 |     const welcomeMessageElem = element(by.id(testIds.welcomeMessage));
> 12 |     await expect(welcomeMessageElem).toBeVisible();
     |                                      ^
  13 |     const welcomeMessageAttrs = await welcomeMessageElem.getAttributes();
  14 |
  15 |     if ('text' in welcomeMessageAttrs) {

  at Object.<anonymous> (e2e/tests/steps/welcomeScreen.test.ts:12:38)

Test Suites: 2 failed, 2 total
Tests: 2 failed, 2 total
Snapshots: 0 total
Time: 42.838 s
Ran all test suites.
17:18:52.333 detox[7737] i user Stopping mock server...
origin: at e2e/testSetup/globalTeardown.ts:29:13
17:18:52.372 detox[7737] i user Mock server stopped



</p>
</details>

Answered by amashianov

Mar 19, 2024

Okay, it seems like the problem was in using an incorrect hardware profile, which wasn't accommodated to CI.
When omitting setting profile directly, it kinda works. Now need to figure out how to configure the emulator for an unusual device.

View full answer

noomorph · 2024-03-19T18:41:46Z

noomorph
Mar 19, 2024
Maintainer

Have you tried all possible gpuMode values? https://wix.github.io/Detox/docs/config/devices/#properties

5 replies

amashianov Mar 19, 2024
Author

Hi, thanks for answering!

Just finished a bunch of runs using host, guest, auto and swiftshader_indirect provided both in step config and detox config.

Unfortunately didn't help. The same problem persists.

noomorph Mar 19, 2024
Maintainer

Try also gpuMode 'off' . If not - well, it looks like your screen is somehow very dependent on hardware acceleration. You may try to mock something out, some animation or some component which causes the problem.

https://wix.github.io/Detox/docs/config/testRunner/#mocking

or you should find another platform for your Android emulators. Depends on your context.

noomorph Mar 19, 2024
Maintainer

fixed link: https://wix.github.io/Detox/docs/guide/mocking

amashianov Mar 19, 2024
Author

Did I understand correctly, that you suspect that screen on buildjet github runner is very dependent on hardware acceleration?

I'm probably missing something, there's no screen in CI, is it?

amashianov Mar 19, 2024
Author

Anyway, tried to launch with hardware acceleration forced on/off – unfortunately same result.

amashianov · 2024-03-19T22:35:15Z

amashianov
Mar 19, 2024
Author

Okay, it seems like the problem was in using an incorrect hardware profile, which wasn't accommodated to CI.
When omitting setting profile directly, it kinda works. Now need to figure out how to configure the emulator for an unusual device.

3 replies

amashianov Mar 20, 2024
Author

Found out the reason:

for some reason in our app android prompts a tutorial for full screen mode if a custom hardware profile is used.
@noomorph by any chance do you know how these are disabled system-wide? They're usually triggerd only once per avd creation, but there's a chicken and the egg problem in the CI which is not present on local :)

noomorph Mar 20, 2024
Maintainer

Maybe this can help, @amashianov ?

android/android-test#406

amashianov Mar 20, 2024
Author

Your search skills are way better than mine it seems 🥇
Was struggling with this since yesterday, thanks! :)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Headless run on buildjet runner #4414

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments 8 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

Select a reply

Headless run on buildjet runner #4414

amashianov Mar 19, 2024

Replies: 2 comments · 8 replies

noomorph Mar 19, 2024 Maintainer

amashianov Mar 19, 2024 Author

noomorph Mar 19, 2024 Maintainer

noomorph Mar 19, 2024 Maintainer

amashianov Mar 19, 2024 Author

amashianov Mar 19, 2024 Author

amashianov Mar 19, 2024 Author

amashianov Mar 20, 2024 Author

noomorph Mar 20, 2024 Maintainer

amashianov Mar 20, 2024 Author

amashianov
Mar 19, 2024

Replies: 2 comments 8 replies

noomorph
Mar 19, 2024
Maintainer

amashianov Mar 19, 2024
Author

noomorph Mar 19, 2024
Maintainer

noomorph Mar 19, 2024
Maintainer

amashianov Mar 19, 2024
Author

amashianov Mar 19, 2024
Author

amashianov
Mar 19, 2024
Author

amashianov Mar 20, 2024
Author

noomorph Mar 20, 2024
Maintainer

amashianov Mar 20, 2024
Author