Skip to content

Parallel tests on ci #692

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 138 commits into
base: main
Choose a base branch
from
Draft

Parallel tests on ci #692

wants to merge 138 commits into from

Conversation

halungge
Copy link
Contributor

@halungge halungge commented Mar 7, 2025

[CI] Adds a minimal pipeline to run the mpi_tests on CSCS-CI.
The pipeline uses its own base image with a minimal MPI installation, and installs icon4py with UV in a test container.

Restrictions of the pipeline setup:

  • tests run only with CPU backends
  • the container based openMPI installation is used, there is no access of the cluster provided MPI infrastructure (same approach as PMAP)
  • DACE orchestration tests in test_parallel_diffusion.py are disabled.

Additional changes

  • All MPI dependent tests are moved to mpi_tests subdirectories for consistent test selection.
  • Issues in the parallel test are fixed.

- remove ipeidx_dsl field from MetricStateNonHydro
- read renamed savepoints
- split VelocityAdvectionInit and VelocityAdvectionExit savepoints
remove unnecessary parameters in test_time_step_flags
remove x- from DiffusionExitSavepoint field names
temporarily ignore saturation adjustment tests - need Weisman-Klemp data
@halungge
Copy link
Contributor Author

halungge commented May 9, 2025

cscs-ci run distributed

@halungge
Copy link
Contributor Author

halungge commented May 9, 2025

cscs-ci run distributed

@halungge
Copy link
Contributor Author

halungge commented May 9, 2025

cscs-ci run distributed

@halungge
Copy link
Contributor Author

cscs-ci run distributed

@halungge
Copy link
Contributor Author

cscs-ci run distributed

@halungge
Copy link
Contributor Author

cscs-ci run distributed

@halungge
Copy link
Contributor Author

cscs-ci run distributed

halungge added 2 commits July 3, 2025 17:12
# Conflicts:
#	model/common/src/icon4py/model/common/interpolation/interpolation_fields.py
#	model/common/tests/grid_tests/mpi_tests/test_parallel_icon.py
#	model/common/tests/grid_tests/test_states.py
@halungge
Copy link
Contributor Author

halungge commented Jul 3, 2025

cscs-ci run distributed

@halungge
Copy link
Contributor Author

halungge commented Jul 4, 2025

cscs-ci run distributed

@halungge
Copy link
Contributor Author

halungge commented Jul 4, 2025

cscs-ci run default

@halungge
Copy link
Contributor Author

halungge commented Jul 4, 2025

cscs-ci run distributed

@halungge
Copy link
Contributor Author

halungge commented Jul 4, 2025

cscs-ci run distributed

Copy link

github-actions bot commented Jul 4, 2025

Mandatory Tests

Please make sure you run these tests via comment before you merge!

  • cscs-ci run default

Optional Tests

To run benchmarks you can use:

  • cscs-ci run benchmark-bencher

To run tests and benchmarks with the DaCe backend you can use:

  • cscs-ci run dace

To run test levels ignored by the default test suite (mostly simple datatest for static fields computations) you can use:

  • cscs-ci run extra

For more detailed information please look at CI in the EXCLAIM universe.

@halungge
Copy link
Contributor Author

halungge commented Jul 4, 2025

cscs-ci run distributed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant