Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Various updates in RADIUSS Spack Configs #1774

Open
wants to merge 26 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
c98c242
From RSC: Do not reuse already installed specs
adrienbernede Oct 14, 2024
b548b16
From RSC: Add externals using following Axom tracks (+ version update)
adrienbernede Oct 15, 2024
7e18e36
From RSC: Fix concretization bug around elfutils
adrienbernede Oct 15, 2024
adc7413
Update RSC with changes from RADIUSS Spack Testing
adrienbernede Oct 21, 2024
75a4cf7
Merge branch 'develop' into woptim/extended-radiuss-envs
adrienbernede Nov 5, 2024
70c72c1
Merge branch 'develop' into woptim/extended-radiuss-envs
adrienbernede Nov 14, 2024
c148188
Merge branch 'develop' into woptim/extended-radiuss-envs
adrienbernede Nov 22, 2024
79e47ef
From RSC and Uberenv: Split env files
adrienbernede Nov 22, 2024
02c4ab3
From RSC: Update tioga toolchain: rocm 6.2.4, cray-mpich 8.1.31, cce …
adrienbernede Nov 26, 2024
ac0a68b
Export hostconfig file as artifact
adrienbernede Nov 28, 2024
2806688
From RSC: Sync with Spack@develop-2024-12-01
adrienbernede Dec 2, 2024
8cab051
Do not unload rocm module
adrienbernede Dec 3, 2024
abce5ff
Revert updating Spack because of problem with develop-2024-12-01
adrienbernede Dec 10, 2024
09a3320
Increase allocation for lassen job clang 16 + openmp-target
adrienbernede Dec 18, 2024
420c063
Update Shared CI
adrienbernede Dec 19, 2024
b2e067e
Merge branch 'develop' into woptim/rsc-update
rhornung67 Dec 19, 2024
1196f0d
From RSC: update to rocm 6.3.0 on tioga + sync with spack@develop + c…
adrienbernede Jan 8, 2025
d496611
From RSC: workarounds (rpath for missing lib) (requirement to enforce…
adrienbernede Jan 10, 2025
b6e3f2f
From RSC: update compiler used for SYCL testing
adrienbernede Jan 10, 2025
41c1ebe
Fix overridden intel jobs now oneapi
adrienbernede Jan 10, 2025
ac22775
From RSC: Update w.r.t. spack@develop-2024-01-12
adrienbernede Jan 13, 2025
5e63e1c
Update module and prepend LD_LIBRARY_PATH for sycl build
adrienbernede Jan 21, 2025
92c22be
Update RADIUSS Spack Configs
adrienbernede Jan 22, 2025
3f590c1
From RSC: change tioga gcc to be coherent with available cray-mpich
adrienbernede Jan 22, 2025
25c39e0
Update RADIUSS Spack Configs to new release
adrienbernede Jan 22, 2025
1773b2f
Merge branch 'develop' into woptim/rsc-update
adrienbernede Jan 24, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .gitlab-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ stages:
include:
- local: '.gitlab/custom-jobs-and-variables.yml'
- project: 'radiuss/radiuss-shared-ci'
ref: 'v2024.06.0'
ref: 'v2024.12.0'
file: 'pipelines/${CI_MACHINE}.yml'
- artifact: '${CI_MACHINE}-jobs.yml'
job: 'generate-job-lists'
Expand Down Expand Up @@ -104,7 +104,7 @@ include:
file: 'id_tokens.yml'
# [Optional] checks preliminary to running the actual CI test
- project: 'radiuss/radiuss-shared-ci'
ref: 'v2024.06.0'
ref: 'v2024.12.0'
file: 'utilities/preliminary-ignore-draft-pr.yml'
# pipelines subscribed by the project
- local: '.gitlab/subscribed-pipelines.yml'
3 changes: 3 additions & 0 deletions .gitlab/custom-jobs-and-variables.yml
Original file line number Diff line number Diff line change
Expand Up @@ -70,6 +70,9 @@ variables:
artifacts:
reports:
junit: junit.xml
name: "${CI_PROJECT_NAME}-${CI_MACHINE}-${CI_JOB_NAME}-${CI_PIPELINE_ID}"
paths:
- ./*.cmake

.reproducer_vars:
script:
Expand Down
8 changes: 5 additions & 3 deletions .gitlab/jobs/corona.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,9 +31,11 @@ rocmcc_5_7_1_hip_desul_atomics:
SPEC: " ~shared +rocm ~openmp +tests +desul amdgpu_target=gfx906 %rocmcc@=5.7.1 ^[email protected]"
extends: .job_on_corona

clang_19_0_0_sycl_gcc_10_3_1_rocmcc_5_7_1_hip:
clang_20_0_0_sycl_gcc_10_3_1_rocmcc_6_0_2_hip:
variables:
SPEC: " ~shared +sycl ~openmp +tests %clang@=19.0.0 cxxflags==\"-w -fsycl -fsycl-unnamed-lambda -fsycl-targets=amdgcn-amd-amdhsa -Xsycl-target-backend --offload-arch=gfx906\""
MODULE_LIST: "rocm/5.7.1"
SPEC: " ~shared +sycl ~openmp +tests %clang@=20.0.0 cxxflags==\"-w -fsycl -fsycl-unnamed-lambda -fsycl-targets=amdgcn-amd-amdhsa -Xsycl-target-backend --offload-arch=gfx906\""
MODULE_LIST: "rocm/6.0.2"
SYCL_PATH: "/usr/WS2/raja-dev/clang_sycl_730cd3a5275f_hip_gcc10.3.1_rocm6.0.2/"
LD_LIBRARY_PATH: "${SYCL_PATH}/lib:${SYCL_PATH}/lib64:${LD_LIBRARY_PATH}"
extends: .job_on_corona

1 change: 1 addition & 0 deletions .gitlab/jobs/lassen.yml
Original file line number Diff line number Diff line change
Expand Up @@ -63,5 +63,6 @@ gcc_8_3_1_cuda_11_7_desul_atomics:
clang_16_0_6_omptarget:
variables:
SPEC: " ~shared +openmp +omptarget +tests %clang@=16.0.6.cuda.11.8.0.gcc.11.2.1"
LASSEN_JOB_ALLOC: "1 -W 60 -q pci"
extends: .job_on_lassen

4 changes: 2 additions & 2 deletions .gitlab/jobs/poodle.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,9 +31,9 @@ gcc_10_3_1:

# custom variant
# https://github.com/LLNL/RAJA/pull/1712#issuecomment-2292006843
intel_2023_2_1:
oneapi_2023_2_1:
variables:
SPEC: "${PROJECT_POODLE_VARIANTS} +lowopttest cxxflags==-fp-model=precise %intel@=2023.2.1 ${PROJECT_POODLE_DEPS}"
SPEC: "${PROJECT_POODLE_VARIANTS} +lowopttest cxxflags==-fp-model=precise %oneapi@=2023.2.1 ${PROJECT_POODLE_DEPS}"
extends: .job_on_poodle

############
Expand Down
4 changes: 2 additions & 2 deletions .gitlab/jobs/ruby.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,9 +31,9 @@ gcc_10_3_1:

# custom variant
# https://github.com/LLNL/RAJA/pull/1712#issuecomment-2292006843
intel_2023_2_1:
oneapi_2023_2_1:
variables:
SPEC: "${PROJECT_RUBY_VARIANTS} +lowopttest cxxflags==-fp-model=precise %intel@=2023.2.1 ${PROJECT_RUBY_DEPS}"
SPEC: "${PROJECT_RUBY_VARIANTS} +lowopttest cxxflags==-fp-model=precise %oneapi@=2023.2.1 ${PROJECT_RUBY_DEPS}"
extends: .job_on_ruby

############
Expand Down
12 changes: 6 additions & 6 deletions .gitlab/jobs/tioga.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,9 +19,9 @@

# Compiler error preventing a test to succeed.
# https://github.com/LLNL/RAJA/pull/1712#issuecomment-2316335119
cce_18_0_0:
cce_18_0_1:
variables:
SPEC: "${PROJECT_TIOGA_VARIANTS} %cce@=18.0.0 ${PROJECT_TIOGA_DEPS}"
SPEC: "${PROJECT_TIOGA_VARIANTS} %cce@=18.0.1 ${PROJECT_TIOGA_DEPS}"
extends: .job_on_tioga
allow_failure: true

Expand All @@ -37,12 +37,12 @@ cce_17_0_1:
SPEC: "${PROJECT_TIOGA_VARIANTS} %cce@=17.0.1 ${PROJECT_TIOGA_DEPS}"
extends: .job_on_tioga

rocmcc_6_2_0_hip_desul_atomics:
rocmcc_6_3_0_hip_desul_atomics:
variables:
SPEC: "~shared +rocm ~openmp +desul +tests amdgpu_target=gfx90a %rocmcc@=6.2.0 ^hip@6.2.0"
SPEC: "~shared +rocm ~openmp +desul +tests amdgpu_target=gfx90a %rocmcc@=6.3.0 ^hip@6.3.0"
extends: .job_on_tioga

rocmcc_6_2_0_hip_openmp:
rocmcc_6_3_0_hip_openmp:
variables:
SPEC: "~shared +rocm +openmp +omptask +tests amdgpu_target=gfx90a %rocmcc@=6.2.0 ^hip@6.2.0"
SPEC: "~shared +rocm +openmp +omptask +tests amdgpu_target=gfx90a %rocmcc@=6.3.0 ^hip@6.3.0"
extends: .job_on_tioga
2 changes: 1 addition & 1 deletion .uberenv_config.json
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"package_final_phase" : "initconfig",
"package_source_dir" : "../..",
"spack_url": "https://github.com/spack/spack.git",
"spack_branch": "develop-2024-10-06",
"spack_branch": "develop-2025-01-12",
"spack_activate" : {},
"spack_configs_path": "scripts/radiuss-spack-configs",
"spack_packages_path": "scripts/radiuss-spack-configs/packages",
Expand Down
4 changes: 0 additions & 4 deletions scripts/gitlab/build_and_test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -202,10 +202,6 @@ then
mkdir -p ${build_dir} && cd ${build_dir}

timed_message "Building RAJA"
if [[ "${truehostname}" == "tioga" ]]
then
module unload rocm
fi
$cmake_exe \
-C ${hostconfig_path} \
-DCMAKE_INSTALL_PREFIX=${install_dir} \
Expand Down
2 changes: 1 addition & 1 deletion scripts/radiuss-spack-configs
Submodule radiuss-spack-configs updated 50 files
+41 −0 RELEASE_NOTES.md
+599 −0 blueos_3_ppc64le_ib/compilers.yaml
+24 −0 blueos_3_ppc64le_ib/config.yaml
+1 −0 blueos_3_ppc64le_ib/lassen/compilers.yaml
+1 −0 blueos_3_ppc64le_ib/lassen/config.yaml
+382 −0 blueos_3_ppc64le_ib/lassen/packages.yaml
+1 −0 blueos_3_ppc64le_ib/lassen/spack.yaml
+384 −0 blueos_3_ppc64le_ib/packages.yaml
+8 −791 blueos_3_ppc64le_ib/spack.yaml
+1 −1 darwin/spack.yaml
+2 −2 gitlab/radiuss-jobs/poodle.yml
+2 −2 gitlab/radiuss-jobs/ruby.yml
+4 −4 gitlab/radiuss-jobs/tioga.yml
+1 −1 packages/blt/package.py
+36 −5 packages/caliper/package.py
+12 −8 packages/camp/package.py
+20 −1 packages/care/package.py
+2 −1 packages/chai/package.py
+0 −13 packages/fmt/fmt-attributes-cpp11_4.1.0.patch
+0 −13 packages/fmt/fmt-no-export-cpp11flag_3.0.0.patch
+0 −22 packages/fmt/fmt-no-variable-initialize_10.0.0.patch
+0 −15 packages/fmt/fmt-use-cmake-cxx-standard_3.0.0.patch
+0 −141 packages/fmt/package.py
+1 −1 packages/raja-perf/package.py
+2 −2 packages/raja/package.py
+1 −1 packages/umpire/package.py
+324 −0 toss_4_x86_64_ib/compilers.yaml
+21 −0 toss_4_x86_64_ib/config.yaml
+311 −0 toss_4_x86_64_ib/corona/compilers.yaml
+1 −0 toss_4_x86_64_ib/corona/config.yaml
+424 −0 toss_4_x86_64_ib/corona/packages.yaml
+1 −0 toss_4_x86_64_ib/corona/spack.yaml
+439 −0 toss_4_x86_64_ib/packages.yaml
+1 −0 toss_4_x86_64_ib/poodle/compilers.yaml
+1 −0 toss_4_x86_64_ib/poodle/config.yaml
+282 −0 toss_4_x86_64_ib/poodle/packages.yaml
+1 −0 toss_4_x86_64_ib/poodle/spack.yaml
+194 −0 toss_4_x86_64_ib/ruby/compilers.yaml
+1 −0 toss_4_x86_64_ib/ruby/config.yaml
+282 −0 toss_4_x86_64_ib/ruby/packages.yaml
+1 −0 toss_4_x86_64_ib/ruby/spack.yaml
+8 −564 toss_4_x86_64_ib/spack.yaml
+261 −0 toss_4_x86_64_ib_cray/compilers.yaml
+20 −0 toss_4_x86_64_ib_cray/config.yaml
+436 −0 toss_4_x86_64_ib_cray/packages.yaml
+8 −566 toss_4_x86_64_ib_cray/spack.yaml
+1 −0 toss_4_x86_64_ib_cray/tioga/compilers.yaml
+1 −0 toss_4_x86_64_ib_cray/tioga/config.yaml
+436 −0 toss_4_x86_64_ib_cray/tioga/packages.yaml
+1 −0 toss_4_x86_64_ib_cray/tioga/spack.yaml
2 changes: 1 addition & 1 deletion scripts/uberenv
Submodule uberenv updated 1 files
+7 −4 uberenv.py
Loading