Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding libraries to dynamic genericx86, and variants to other systems #467

Merged
merged 23 commits into from
Jan 21, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 14 additions & 13 deletions .github/workflows/run.yml
Original file line number Diff line number Diff line change
Expand Up @@ -224,7 +224,7 @@ jobs:

- name: Dry run dynamic gromacs/openmp with dynamic Ruby
run: |
./bin/benchpark system init --dest=cluster-system llnl-cluster compiler=gcc lapack=intel-oneapi-mkl blas=intel-oneapi-mkl
./bin/benchpark system init --dest=cluster-system llnl-cluster compiler=gcc
system_id=$(./bin/benchpark system id ./cluster-system)
./bin/benchpark experiment init --dest=gromacs-openmp gromacs +openmp~cuda~rocm gpu-aware-mpi=off
./bin/benchpark setup ./gromacs-openmp ./cluster-system workspace/
Expand Down Expand Up @@ -376,9 +376,9 @@ jobs:
--disable-logger \
workspace setup --dry-run

- name: Dry run dynamic saxpy/openmp with dynamic llnl-cluster ruby
- name: Dry run dynamic saxpy/openmp with dynamic llnl-cluster ruby compiler=intel
run: |
./bin/benchpark system init --dest=ruby-system llnl-cluster cluster=ruby
./bin/benchpark system init --dest=ruby-system llnl-cluster cluster=ruby compiler=intel
system_id=$(./bin/benchpark system id ./ruby-system)
./bin/benchpark experiment init --dest=saxpy-openmp saxpy+openmp
./bin/benchpark setup ./saxpy-openmp ./ruby-system workspace/
Expand Down Expand Up @@ -414,32 +414,33 @@ jobs:
--disable-logger \
workspace setup --dry-run

- name: Dry run dynamic saxpy/openmp with dynamic generic x86
- name: Dry run dynamic amg2023+openmp with dynamic generic x86
run: |
./bin/benchpark system init --dest=x86-system genericx86
./bin/benchpark experiment init --dest=saxpy-omp-generic saxpy+openmp
./bin/benchpark setup ./saxpy-omp-generic ./x86-system workspace/
./bin/benchpark experiment init --dest=amg2023-openmp-generic amg2023+openmp
./bin/benchpark setup ./amg2023-openmp-generic ./x86-system workspace/
. workspace/setup.sh
ramble \
--workspace-dir "workspace/saxpy-omp-generic/x86-system/workspace" \
--workspace-dir "workspace/amg2023-openmp-generic/x86-system/workspace" \
--disable-progress-bar \
--disable-logger \
workspace setup --dry-run

- name: Dry run dynamic saxpy/openmp with dynamic aws
run: |
./bin/benchpark system init --dest=aws1 aws-pcluster instance_type=hpc6a.48xlarge
./bin/benchpark setup ./saxpy-omp-generic ./aws1 workspace/
./bin/benchpark experiment init --dest=saxpy-openmp-generic saxpy+openmp
./bin/benchpark setup ./saxpy-openmp-generic ./aws1 workspace/
. workspace/setup.sh
ramble \
--workspace-dir "workspace/saxpy-omp-generic/aws1/workspace" \
--workspace-dir "workspace/saxpy-openmp-generic/aws1/workspace" \
--disable-progress-bar \
--disable-logger \
workspace setup --dry-run

- name: Dry run dynamic remhos/mpi with dynamic Ruby
run: |
./bin/benchpark system init --dest=cluster-system1 llnl-cluster compiler=gcc lapack=intel-oneapi-mkl blas=intel-oneapi-mkl
./bin/benchpark system init --dest=cluster-system1 llnl-cluster compiler=gcc
system_id=$(./bin/benchpark system id ./cluster-system1)
./bin/benchpark experiment init --dest=remhos-mpi-ruby remhos ~cuda~rocm caliper=mpi,time
./bin/benchpark setup ./remhos-mpi-ruby ./cluster-system1 workspace/
Expand Down Expand Up @@ -517,11 +518,11 @@ jobs:
- name: Dry run dynamic saxpy/openmp with dynamic fugaku
run: |
./bin/benchpark system init --dest=fugaku-system fugaku
./bin/benchpark experiment init --dest=saxpy-omp-fugaku saxpy+openmp
./bin/benchpark setup ./saxpy-omp-fugaku ./fugaku-system workspace/
./bin/benchpark experiment init --dest=saxpy-openmp-fugaku saxpy+openmp
./bin/benchpark setup ./saxpy-openmp-fugaku ./fugaku-system workspace/
. workspace/setup.sh
ramble \
--workspace-dir workspace/saxpy-omp-fugaku/Fugaku-cf3cb1d/workspace \
--workspace-dir workspace/saxpy-openmp-fugaku/Fugaku-cf3cb1d/workspace \
--disable-progress-bar \
--disable-logger \
workspace setup --dry-run
Expand Down
4 changes: 2 additions & 2 deletions experiments/amg2023/experiment.py
Original file line number Diff line number Diff line change
Expand Up @@ -140,8 +140,8 @@ def compute_spack_section(self):
system_specs = {}
system_specs["compiler"] = "default-compiler"
system_specs["mpi"] = "default-mpi"
system_specs["lapack"] = "default-lapack"
system_specs["blas"] = "default-blas"
system_specs["lapack"] = "lapack"
system_specs["blas"] = "blas"

# set package spack specs
# empty package_specs value implies external package
Expand Down
4 changes: 2 additions & 2 deletions experiments/gromacs/experiment.py
Original file line number Diff line number Diff line change
Expand Up @@ -93,8 +93,8 @@ def compute_spack_section(self):
system_specs = {}
system_specs["compiler"] = "default-compiler"
system_specs["mpi"] = "default-mpi"
system_specs["blas"] = "default-blas"
system_specs["lapack"] = "default-lapack"
system_specs["blas"] = "blas"
system_specs["lapack"] = "lapack"

# set package spack specs
# empty package_specs value implies external package
Expand Down
4 changes: 2 additions & 2 deletions experiments/laghos/experiment.py
Original file line number Diff line number Diff line change
Expand Up @@ -66,8 +66,8 @@ def compute_spack_section(self):
system_specs = {}
system_specs["compiler"] = "default-compiler"
system_specs["mpi"] = "default-mpi"
system_specs["lapack"] = "default-lapack"
system_specs["blas"] = "default-blas"
system_specs["lapack"] = "lapack"
system_specs["blas"] = "blas"

# set package spack specs
# empty package_specs value implies external package
Expand Down
4 changes: 2 additions & 2 deletions experiments/remhos/experiment.py
Original file line number Diff line number Diff line change
Expand Up @@ -92,8 +92,8 @@ def compute_spack_section(self):
system_specs = {}
system_specs["compiler"] = "default-compiler"
system_specs["mpi"] = "default-mpi"
system_specs["lapack"] = "default-lapack"
system_specs["blas"] = "default-blas"
system_specs["blas"] = "blas"
system_specs["lapack"] = "lapack"

# set package spack specs
# empty package_specs value implies external package
Expand Down
4 changes: 4 additions & 0 deletions systems/genericx86/system.py
Original file line number Diff line number Diff line change
Expand Up @@ -40,4 +40,8 @@ def sw_description(self):
pkg_spec: gcc
default-mpi:
pkg_spec: openmpi
blas:
pkg_spec: openblas
lapack:
pkg_spec: openblas
"""
18 changes: 1 addition & 17 deletions systems/llnl-cluster/system.py
Original file line number Diff line number Diff line change
Expand Up @@ -37,18 +37,6 @@ class LlnlCluster(System):
description="Which compiler to use",
)

variant(
"lapack",
default="intel-oneapi-mkl",
description="Which lapack to use",
)

variant(
"blas",
default="intel-oneapi-mkl",
description="Which blas to use",
)

def initialize(self):
super().initialize()

Expand Down Expand Up @@ -97,13 +85,9 @@ def sw_description(self):
software:
packages:
default-compiler:
pkg_spec: gcc
pkg_spec: {self.spec.variants["compiler"][0]}
default-mpi:
pkg_spec: mvapich2
default-lapack:
pkg_spec: {self.spec.variants["lapack"][0]}
default-blas:
pkg_spec: {self.spec.variants["blas"][0]}
compiler-gcc:
pkg_spec: gcc
compiler-intel:
Expand Down
16 changes: 7 additions & 9 deletions systems/llnl-elcapitan/system.py
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ class LlnlElcapitan(System):
variant(
"compiler",
default="cce",
values=("gcc", "cce"),
values=("cce", "gcc"),
description="Which compiler to use",
)

Expand Down Expand Up @@ -373,13 +373,9 @@ def sw_description(self):
software:
packages:
default-compiler:
pkg_spec: cce
pkg_spec: {self.spec.variants["compiler"][0]}
default-mpi:
pkg_spec: cray-mpich
default-lapack:
pkg_spec: {self.spec.variants["lapack"][0]}
default-blas:
pkg_spec: {self.spec.variants["blas"][0]}
compiler-rocm:
pkg_spec: cce
compiler-amdclang:
Expand All @@ -393,11 +389,13 @@ def sw_description(self):
mpi-gcc:
pkg_spec: cray-mpich~gtl
blas:
pkg_spec: rocblas
pkg_spec: {self.spec.variants["blas"][0]}
blas-rocm:
pkg_spec: rocblas
lapack-rocm:
pkg_spec: rocsolver
lapack:
pkg_spec: {self.spec.variants["lapack"][0]}
lapack-oneapi:
pkg_spec: intel-oneapi-mkl
lapack-rocm:
pkg_spec: rocsolver
"""
12 changes: 6 additions & 6 deletions systems/llnl-sierra/system.py
Original file line number Diff line number Diff line change
Expand Up @@ -298,17 +298,13 @@ def sw_description(self):
will fail if these variables are not defined though, so for now
they are still generated (but with more-generic values).
"""
return f"""\
return """\
software:
packages:
default-compiler:
pkg_spec: clang
default-mpi:
pkg_spec: spectrum-mpi
default-lapack:
pkg_spec: {self.spec.variants["lapack"][0]}
default-blas:
pkg_spec: {self.spec.variants["blas"][0]}
compiler-xl:
pkg_spec: xl
mpi-xl:
Expand All @@ -325,6 +321,10 @@ def sw_description(self):
pkg_spec: spectrum-mpi
blas:
pkg_spec: cublas
cublas-cuda:
blas-cuda:
pkg_spec: cublas
lapack:
pkg_spec: cusolver
lapack-cuda:
pkg_spec: cusolver
"""