Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snapshot for 20241112, v20.0.0, c280522 (big-merge) #857

Open
github-actions bot opened this issue Nov 12, 2024 · 35 comments
Open

Snapshot for 20241112, v20.0.0, c280522 (big-merge) #857

github-actions bot opened this issue Nov 12, 2024 · 35 comments

Comments

@github-actions
Copy link

github-actions bot commented Nov 12, 2024

This issue exists to let you know that we are about to monitor the builds of the LLVM (v20.0.0, llvm/llvm-project@ c280522) snapshot for 20241112.

At certain intervals the CI system will update this very comment over time to reflect the progress of builds.
Log analysis
For example if a build of the llvm project fails on the fedora-rawhide-x86_64 platform, we'll analyze the build log (if any) to identify the cause of the failure. The cause can be any of ['srpm_build_issue', 'copr_timeout', 'network_issue', 'dependency_issue', 'test', 'downstream_patch_application', 'rpm__installed_but_unpackaged_files_found', 'rpm__directory_not_found', 'rpm__file_not_found', 'cmake_error', 'unknown']. For each cause we will list the packages and the relevant log excerpts.
Use of labels
Let's assume a unit test test in upstream LLVM was broken. We will then add these labels to this issue: error/test, build_failed_on/fedora-rawhide-x86_64, project/llvm. If you manually restart a build in Copr and can bring it to a successful state, we will automatically remove the aforementioned labels.

Last updated: 2024-11-14T23:24:04.183086

Build Matrix
llvm
fedora-39-aarch64
❌ tests error
fedora-39-i386
fedora-39-ppc64le
✅ tests passed 🔒
fedora-39-s390x
✅ tests passed 🔒
fedora-39-x86_64
❌ tests error
fedora-40-aarch64
✅ tests passed
fedora-40-i386
fedora-40-ppc64le
✅ tests passed 🔒
fedora-40-s390x
Copr build(s) failed
fedora-40-x86_64
✅ tests passed
fedora-41-aarch64
❌ tests error
fedora-41-i386
fedora-41-ppc64le
✅ tests passed 🔒
fedora-41-s390x
✅ tests passed 🔒
fedora-41-x86_64
Copr build(s) failed
fedora-rawhide-aarch64
❌ tests error
fedora-rawhide-i386
fedora-rawhide-ppc64le
✅ tests passed 🔒
fedora-rawhide-s390x
✅ tests passed 🔒
fedora-rawhide-x86_64
❌ tests error
rhel-8-aarch64
❌ tests error 🔒
rhel-8-s390x
❌ tests error 🔒
rhel-8-x86_64
✅ tests passed 🔒
rhel-9-aarch64
✅ tests passed 🔒
rhel-9-s390x
✅ tests passed 🔒
rhel-9-x86_64
✅ tests passed 🔒
Build status legend
  • ⭕ : canceled
  • ❌ : failed
  • ☑️ : forked
  • 📥 : importing
  • 🔜 : pending
  • 🏃 : running
  • 🚫 : skipped
  • ⭐ : starting
  • ✅ : succeeded
  • ⌛ : waiting
  • ❔ : unknown
  • ⚠️ : pipeline error (only relevant to testing-farm)

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copy link
Author

github-actions bot commented Nov 12, 2024

Errors found in Copr builds on fedora-40-s390x

  • test
    1. llvm on fedora-40-s390x (see build log, contribute to log-detective)
      TEST 'libarcher :: races/taskwait-depend.c' FAILED
      ******************** TEST 'libarcher :: races/taskwait-depend.c' FAILED ********************
      Exit Code: 2
      
      Command Output (stdout):
      --
      # RUN: at line 14
      /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/./bin/clang -fopenmp  -gdwarf-4 -O1 -fsanitize=thread  -I /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/openmp/tools/archer/tests -I /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/runtime/src -L /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/runtime/src -Wl,-rpath,/builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/runtime/src   /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/openmp/tools/archer/tests/races/taskwait-depend.c -o /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/tools/archer/tests/races/Output/taskwait-depend.c.tmp -latomic && env TSAN_OPTIONS='ignore_noninstrumented_modules=0:ignore_noninstrumented_modules=1' /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/openmp/tools/archer/tests/deflake.bash /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/tools/archer/tests/races/Output/taskwait-depend.c.tmp 2>&1 | tee /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/tools/archer/tests/races/Output/taskwait-depend.c.tmp.log | /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/./bin/FileCheck /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/openmp/tools/archer/tests/races/taskwait-depend.c
      # executed command: /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/./bin/clang -fopenmp -gdwarf-4 -O1 -fsanitize=thread -I /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/openmp/tools/archer/tests -I /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/runtime/src -L /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/runtime/src -Wl,-rpath,/builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/runtime/src /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/openmp/tools/archer/tests/races/taskwait-depend.c -o /builddir/build/BUILD/llvm-project-c280522f7e359117adde10de4158f9f6fec20a7b/llvm/redhat-linux-build/runtimes/runtimes-bins/openmp/tools/arch
      

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copy link
Author

github-actions bot commented Nov 12, 2024

Errors found in Copr builds on fedora-41-x86_64

  • rpm__installed_but_unpackaged_files_found
    1. llvm on fedora-41-x86_64 (see build log, contribute to log-detective)
      Installed (but unpackaged) file(s) found:
         /usr/lib/clang/20/lib/i386-redhat-linux-gnu/clang_rt.crtbegin.o
         /usr/lib/clang/20/lib/i386-redhat-linux-gnu/clang_rt.crtend.o
         /usr/lib/clang/20/lib/i386-redhat-linux-gnu/libclang_rt.builtins.a
          absolute symlink: /usr/bin/clang-format-diff -> /usr/share/clang/clang-format-diff.py
          Installed (but unpackaged) file(s) found:
         /usr/lib/clang/20/lib/i386-redhat-linux-gnu/clang_rt.crtbegin.o
         /usr/lib/clang/20/lib/i386-redhat-linux-gnu/clang_rt.crtend.o
         /usr/lib/clang/20/lib/i386-redhat-linux-gnu/libclang_rt.builtins.a
      Finish: rpmbuild llvm-20.0.0~pre20241112.gc280522f7e3591-1.fc41.src.rpm
      Finish: build phase for llvm-20.0.0~pre20241112.gc280522f7e3591-1.fc41.src.rpm
      INFO: chroot_scan: 1 files copied to /var/lib/copr-rpmbuild/results/chroot_scan
      INFO: /var/lib/mock/fedora-41-x86_64-1731377394.046418/root/var/log/dnf5.log
      INFO: chroot_scan: creating tarball /var/lib/copr-rpmbuild/results/chroot_scan.tar.gz
      /bin/tar: Removing leading `/' from member names
      ERROR: Exception(/var/lib/copr-rpmbuild/results/llvm-20.0.0~pre20241112.gc280522f7e3591-1.fc41.src.rpm) Config(fedora-41-x86_64) 35 minutes 29 seconds
      INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
      INFO: Cleaning up build root ('cleanup_on_failure=True')
      Start: clean chroot
      INFO: unmounting tmpfs.
      Finish
      

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@nikic
Copy link
Collaborator

nikic commented Nov 12, 2024

llvm18 compat build for RHEL 8 in progress here: https://copr.fedorainfracloud.org/coprs/g/fedora-llvm-team/llvm-compat-packages/build/8246474/

Based on this branch: https://src.fedoraproject.org/fork/nikic/rpms/llvm18/c/449438b9bc9121a5e31de7949824fde346d06bea?branch=rhel-8

This should fix the tmt tests.

@tuliom
Copy link
Collaborator

tuliom commented Nov 12, 2024

I created a PR that helps to debug the issue with lack of disk space.

@tuliom
Copy link
Collaborator

tuliom commented Nov 12, 2024

The issue with i386 headers on x86_64 on Fedora 41 will be fixed with glibc-2.40-11.fc41 in the following Bodhi update: https://bodhi.fedoraproject.org/updates/FEDORA-2024-bd3757cab1

@nikic
Copy link
Collaborator

nikic commented Nov 12, 2024

/retest rhel-8-x86_64

@nikic
Copy link
Collaborator

nikic commented Nov 12, 2024

@tuliom In case you're not aware, I expect the rawhide aarch64 profiling failure is llvm/llvm-project#114605.

@tstellar
Copy link
Collaborator

The issue with i386 headers on x86_64 on Fedora 41 will be fixed with glibc-2.40-11.fc41 in the following Bodhi update: https://bodhi.fedoraproject.org/updates/FEDORA-2024-bd3757cab1

For some of the builds last week, I added the updates repo to the "Additional Repos" and re-ran the build so it would pass.

@tuliom
Copy link
Collaborator

tuliom commented Nov 12, 2024

I collected more details about the rsync failures that we've been seeing and reported it at teemtee/tmt#3359

@tuliom
Copy link
Collaborator

tuliom commented Nov 19, 2024

The rsync failures have been fixed with https://gitlab.com/testing-farm/gluetool-modules/-/merge_requests/836 .
This should become available in the next TF update in production.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment