Github suddenly got segfaulty?

[dvarrazzo]

Hello,

Psycopg 3 is configured to build binary packages weekly, and the last job is showing segfaults in manylinux builds for ppc64le and aarch64 platforms. The same job last week didn't show any failure and there was no change in the code between the two.

I have attached the logs of the ppc64le, cp39, manylinux run. These logs have timestamps stripped and few other irrelevant differences removed (such as the order of the docker layers pulled) for ease of comparison:

• job-logs-good.txt is the successful job;
• job-logs-bad.txt is attempt 3 of the failed job, which had some libraries cached;
• job-logs-bad-2.txt is attempt 4 of the failed job, run after cleaning the cache, with all depending libraries built from sources.

Does anyone see anything obvious about the segfaults?

Thank you very much!

[joerick]

I believe you're hitting a bug around setup-qemu-action. I didn't see it myself but @mayeut just pushed this fix to our repo-

4538497

The referenced issues are docker/setup-qemu-action#188 and tonistiigi/binfmt#215. @mayeut's workaround is the following in a github workflow-

    - name: Set up QEMU
      if: runner.os == 'Linux'
      uses: docker/setup-qemu-action@v3
      with:
        # This should be temporary
        # xref https://github.com/docker/setup-qemu-action/issues/188
        # xref https://github.com/tonistiigi/binfmt/issues/215
        image: tonistiigi/binfmt:qemu-v8.1.5

[dvarrazzo]

This worked indeed, thank you for your input.

[henryiii]

AArch only, you can use the new native images ubuntu-22.04-arm and ubuntu-24.04-arm, which are not emulated (so avoid the bug) and 10x faster too.