Resource loading error causes tests to not run

[Razzlegames]

Anyone else have this issue or found a work around?

It seems there are cache files created by Godot on first run, for textures and other resources. If I use the CI/CD it appears these are not present and e.g. test_whiteRockPillarCollisions doesn't run:

   At: core/io/resource_format_binary.cpp:998.
ERROR: _load: Failed loading resource: res://.import/hord_collect.wav-978736fa4f5f62f4b2ce7afbde0827fd.sample. Make sure resources have been imported by opening the project in the editor at least once.
   At: core/io/resource_loader.cpp:279.
ERROR: _load: Failed loading resource: res://Sounds/hord_collect.wav. Make sure resources have been imported by opening the project in the editor at least once.
   At: core/io/resource_loader.cpp:279.
ERROR: poll: res://Prefabs/Collectables/Collectable.tscn:10 - Parse Error: [ext_resource] referenced nonexistent resource at: res://Sounds/hord_collect.wav
   At: scene/resources/resource_format_text.cpp:440.
ERROR: load: Failed to load resource 'res://Prefabs/Collectables/Collectable.tscn'.
   At: core/io/resource_loader.cpp:208.
ERROR: _load: Failed loading resource: res://Prefabs/Collectables/Collectable.tscn. Make sure resources have been imported by opening the project in the editor at least once.
   At: core/io/resource_loader.cpp:279.
ERROR: poll: res://Prefabs/Collectables/HiddenCollectableRigidBody2D.tscn:4 - Parse Error: [ext_resource] referenced nonexistent resource at: res://Prefabs/Collectables/Collectable.tscn
   At: scene/resources/resource_format_text.cpp:440.
ERROR: load: Failed to load resource 'res://Prefabs/Collectables/HiddenCollectableRigidBody2D.tscn'.
   At: core/io/resource_loader.cpp:208.
ERROR: _load: Failed loading resource: res://Prefabs/Collectables/HiddenCollectableRigidBody2D.tscn. Make sure resources have been imported by opening the project in the editor at least once.
   At: core/io/resource_loader.cpp:279.
SCRIPT ERROR: before_each: Attempt to call function 'instance' in base 'null instance' on a null instance.
   At: res://Tests/UnitTests/collisionTests/test_whiteRockPillarCollisions.gd:26.

My Gitlab CI/CD

image: barichello/godot-ci:3.2.3

stages:
  - tests
  - export
  - deploy

before_script:
  - mkdir -v -p build/linux
  - mkdir -v -p build/windows
  - mkdir -v -p build/mac
  - mkdir -v -p build/web

unitTests:
  stage: tests
  script:
    - cd Godot/Project
    - find 
    - echo "Init import cache"
    - godot --editor --quit
    - godot -s --verbose addons/gut/gut_cmdln.gd --path $PWD -ginclude_subdirs -gdir=res://Tests -gexit -gprefix=test_

linux:
  stage: export
  script:
    - cd Godot/Project
    - godot -v --export "Linux/X11" ../../build/linux/$EXPORT_NAME.x86_64
    - test -e ../../build/linux/$EXPORT_NAME.x86_64
  artifacts:
    name: $EXPORT_NAME-$CI_JOB_NAME-$CI_COMMIT_BRANCH
    paths:
      - build/linux
  only:
      - release
      - master

windows:
  stage: export
  script:
    - cd Godot/Project
    - godot -v --export "Windows Desktop" ../../build/windows/$EXPORT_NAME.exe
    - test -e ../../build/windows/$EXPORT_NAME.exe
  artifacts:
    name: $EXPORT_NAME-$CI_JOB_NAME-$CI_COMMIT_BRANCH
    paths:
      - build/windows
  only:
      - release
      - master

mac:
  stage: export
  script:
    - cd Godot/Project
    - godot -v --export "Mac OSX" ../../build/mac/$EXPORT_NAME.zip
    - test -e ../../build/mac/$EXPORT_NAME.zip
  artifacts:
    name: $EXPORT_NAME-$CI_JOB_NAME-$CI_COMMIT_BRANCH
    paths:
      - build/mac
  only:
      - release
      - master

web:
  stage: export
  script:
    - cd Godot/Project
    - godot -v --export "HTML5" ../../build/web/index.html
    - test -e ../../build/web/index.html
  artifacts:
    name: $EXPORT_NAME-$CI_JOB_NAME-$CI_COMMIT_BRANCH
    paths:
      - build/web
  only:
      - release

I've tried running first in the CI to init the cache, but I am clearly missing something about how Godot in headless mode works.