Releases: JCSDA/spack-stack
Version 1.9.3
We are pleased to announce the release of V1.9.3 of spack-stack.
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), the Earth Prediction Innovation Center (EPIC), the United States Naval Research Lab (NRL), and the NASA Global Modeling and Assimilation Office (GMAO). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS), the Joint Effort for Data assimilation Integration (JEDI), the Navy Environmental Prediction sysTem Using a Nonhydrostatic Engine (NEPTUNE), and the NASA Goddard Earth Observing System (GEOS) model.
Documentation for installing and using spack-stack can be found at https://spack-stack.readthedocs.io/en/1.9.3 and https://github.com/JCSDA/spack-stack/wiki/spack%E2%80%90stack%E2%80%901.9.3-release-documentation
What's Changed
This is a bug fix release for versions 1.9.1 and 1.9.2. Changes w.r.t. version 1.9.1:
- Site config updates and bug fixes for WCOSS2, Derecho, Hercules, Orion, Ursa, Hera
- Bug fixes for scotch and crtm-fix packages
- wgrib2: support variants ipolates and netcdf
- Update met and metplus versions. Note that
[email protected]does not compile without older versions ofgcc(e.g.[email protected]). See the Known Issues section of the release documentation for a fix - New tier 1 site NAS (NASA)
Full Changelog: spack-stack-1.9.1...1.9.3
Version 1.9.1
We are pleased to announce the release of V1.9.1 of spack-stack.
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), the Earth Prediction Innovation Center (EPIC), and the United States Naval Research Lab (NRL). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS), the Joint Effort for Data assimilation Integration (JEDI), and the Navy Environmental Prediction sysTem Using a Nonhydrostatic Engine (NEPTUNE).
Documentation for installing and using spack-stack can be found at https://spack-stack.readthedocs.io/en/1.9.1 and https://github.com/JCSDA/spack-stack/wiki/spack%E2%80%90stack%E2%80%901.9.1-release-documentation
What's Changed
Platforms
- Add site configs for NCO WCOSS2, NOAA RDHPCS Ursa
- Add experimental support for DoD HPCMP Blueback, DOD HPCMP ParallelWorks AWS
- Update JEDI CI container from Ubuntu 20.04 to Ubuntu 24.04
- On NRL sites, Hercules, and Orion, use native
zlibinstead of spack-builtzlib-ng
Compilers
- Support for Intel oneAPI compilers in "mixed" mode (
icx,icpx,ifortfrom[email protected]and[email protected]) - Support for
[email protected]compilers on macOS andclang@14on Linux - Experimental support for Intel oneAPI compilers (
icx,icpx,ifxfrom fromoneapi@2025and later)
Libraries
- Move NEPTUNE Python dependencies into its their own package neptune-python-env
- Updated versions for:
ip,gfsio,landsfcutil,sigio,sfcio,eckit,fckit,fiat,ectrans,ecmwf-atlas - Unpin or update many Python packages, update of
py-numpyto 1.26 andpy-scipyto 1.14 - Enable ESMF Python interface, update to version 8.8.0
- Update MAPL to 2.50.3
- Add the GitHub CLI to
global-workflow-env - Add
py-ruameltogmao-swell-env - Enable
esdmumpsfeature forscotch - New package
bufr-query - Add new templates for Cylc and CCPP-SCM
- Add
[email protected] - Update
wgrib2to 3.6.0 and enable for all compilers (notably Intel oneAPI)
Miscellaneous
- Implement NCO requirements
- Continuous Integration (CI): add weekly build/test scripts
- Add utility for listing pkg versions for spack-stack wiki
Full Changelog: spack-stack-1.8.0...spack-stack-1.9.1
Version 1.8.0
We are pleased to announce the release of V1.8.0 of spack-stack.
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), the Earth Prediction Innovation Center (EPIC), and the United States Naval Research Lab (NRL). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS), the Joint Effort for Data assimilation Integration (JEDI), and the Navy Environmental Prediction sysTem Using a Nonhydrostatic Engine (NEPTUNE).
Documentation for installing and using spack-stack can be found at https://spack-stack.readthedocs.io/en/1.8.0 and https://github.com/JCSDA/spack-stack/wiki/spack%E2%80%90stack%E2%80%901.8.0-release-documentation
New This Release
- Support for Intel oneAPI 2024 compilers (icx, icpx, ifort; experimental: icx, icpx, ifx); update of Intel classic compilers to last release 2023.2 on NOAA platforms
- Bug fixes for Intel classic compilers in spack core code (always pass flags to suppress deprecation warnings to fix meson build errors)
- Support for AMD AOCC version 4 compilers (experimental)
- Minimal mpas-jedi environment with Nvidia compilers (nvhpc)
- New NEPTUNE standalone environment
- Environments now support one principal compiler, but can use other compilers for specific packages (examples: Intel classic environment uses gcc to compile boost; Intel oneAPI environment uses gcc to compile bison)
- Use Intel MKL instead of Openblas in Intel classic/oneAPI environments on all non-NOAA platforms
- Update of Python from 3.10.8 to 3.11.7 and update of numerous Python packages
- Additional packages for unified environment: py-dask, py-xnrl, py-wxflow, command line utilities for eccodes, py-fortranformat, bufr_query
- New versions of [email protected], [email protected] and [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]
- Update to Rocky 8 for NOAA RDHPCS Hera, Jet, ParallelWorks
- Update to Rocky 9 for NOAA RDHPCS Orion
- Update of JEDI CI container builds
- New tier 1 platforms Atlantis, Gaea C6
- Update from spack develop as of May 2024
- Documentation updates: split documentation into readthedocs (https://spack-stack.readthedocs.io/en/latest) and a Wiki (https://github.com/JCSDA/spack-stack/wiki)
Version 1.7.0
We are pleased to announce the release of V1.7.0 of spack-stack.
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).
Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.7.0/
New This Release
- Add all packages required to build GEOS-GCM with spack-stack, add geos-gcm-env (thanks to Matthew Thompson from NASA GMAO)
- Extend support for spack-stack to NASA's Discover SCU17 (AMD Milan) partition, update Discover SCU16 (Intel CascadeLake) config
- Update Hera and Jet site configs after transition to Rocky 8
- Add metis and jasper to mpas-jedi-env
- Add fftw and netlib-lapack to jedi-neptune-env
- Add torch/pytorch for gcc and apple-clang environments
- Replace zlib with zlib-ng
- Remove upp from spack-stack installations
- Update ECMWF library versions (eccodes, eckit, fckit, ecmwf-atlas)
- Update esmf to 8.6.0, update [email protected] dependencies (pflogger)
- Update hdf5 to 1.14.3 with backport of floating point exception fixes from hdf5 develop (thanks to Ryan Honeyager from tomorrow.io)
- Update sp, ip, gsibec
- Update OpenMPI version for user systems to 5.0.1
- Bugfix for [email protected] static/fix files
- Bugfix for building py-jupyter server with node/npm
- Limited support for [email protected]
- Update to spack backports/v0.21.1
- Stop packages from access the internet during installation (needed for air-gapped systems)
Version 1.6.0
We are pleased to announce the release of V1.6.0 of spack-stack.
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).
Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.6.0/
New This Release
- Library updates:
[email protected],[email protected]with[email protected]in addition to[email protected]with[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected], - New packages:
[email protected],[email protected],[email protected],[email protected],[email protected] - Support for GEOS SWELL workflow via the newly added
geos-swell-envvirtual package (available inunified-envandskylab-env) - Additional environment
gsi-addon-envthat uses[email protected],[email protected],[email protected] - Support of
[email protected]compiler - Update of
spack stack create ctrextension to build containers with different packages - Update of
spack stack setup-meta-modulesextension to work correctly with chained environments - Bug fixes for Nautilus, Derecho, Hercules
- Alternative
[email protected]+[email protected]software stack on Hercules (in addition to the default[email protected]+[email protected]stack) that seems to address the random errors of MPI programs of the default GNU stack
Version 1.5.1
V1.5.1 is a minor update of V1.5.0 with new library versions for NOAA's Unified Forecast System (UFS) and JCSDA's Joint Effort for Data assimilation Integration (JEDI).
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).
Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.5.1/
New This Release
This is a minor update on top of V1.5.0:
- Update of Hercules site config for GNU compiler to fix issues with the Unified Forecast System due to a bug in gcc@11 (move to gcc@12)
- Update of bufr to 12.0.1
- Update of ecmwf-atlas to 0.35.0, enabling tesselation features
- Update fms to 2023.02.01, addition of version 2023.03
- Update of esmf to 8.5.0, mapl to 2.40.3, and update of mapl dependencies
- Update of gsi-ncdiag to 1.1.2
- Bug fix for py-pandas / py-openpyxl
- Various smaller site configuration updates (Python with/without ssl enabled) to fix openssh/openssl library version mismatches
Version 1.5.0
We are pleased to announce the release of V1.5.0 of spack-stack.
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).
Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.5.0/
New This Release
- Support for MSU Hercules, NOAA RDHPCS Gaea C5, NCAR-Wyoming Derecho
- Major update from spack authoritative repository to
0.21.0.dev0 - Use of C++-17 in
boostand in several new versions of ECMWF libraries (eckit,fckit,ecmwf-atlas, ...) - The Python version used by downstream applications of spack-stack is now built by spack (no longer an external package) for most platforms
- Additional CI tests, in particular on macOS M1
- Utility to check for duplicates after concretization
- Utility to check user
umaskwhen creating environments - Fixed several bugs in
spack stack setup-meta-modules - Numerous version updates and bug fixes for packages in the unified environment, including a critical bug fix to
scotch(version 7.0.4) and an update ofNCEPLIBS-bufrto 12.0.0 - Additional packages for working with cloud resources (
awscli,globus-cli) - Static build options for packages required by the UFS Weather Model for installation on NCO's operational systems
Version 1.4.1
V1.4.1 is a bug fix release specifically for enabling the transition of NOAA's Unified Forecast System (UFS) to spack-stack.
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).
Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.4.1/
New This Release
This is a bug fix release on top of V1.4.0:
- Bug fix for the scotch library required for coupled UFS configurations
- Update of bufr from 11.7.1 to 1.12.0
- Update of eckit from 1.23.0 to 1.23.1
- Update of Hercules and Gaea C5 site configurations
Version 1.4.0
We are pleased to announce the release of V1.4.0 of spack-stack.
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).
Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.4.0/
New This Release
- Support for the Navy Nautilus HPC
- Experimental support for MSU's Hercules and NOAA's Gaea C5
- Addition of jedi-neptune-env
- Addition of scotch to ufs-weather-model-env
- Update hdf5 and py-h5py to 1.14.0 and 3.7.0
- Major update from spack authoritative repository to a version close to the recently released spack v0.20.0
- Several small bug fixes and updates
Known Issues
- Build error: mapl 2.35.2 does not build on the Navy Narwhal HPC, therefore removed ufs-weather-model-env and jedi-ufs-env from that system
- GNU environment on S4 currently not supported, because new HDF5 version requires newer MPI library than currently available (mpich-4.0.1); newer mpich versions cannot build mapl 2.35.2.
- Substituted wgrib2 2.0.8 with 3.1.1 on Hercules and Nautilus
Version 1.3.1
V1.3.1 is an internal bug fix release required for specific uses cases that have problems with [email protected] (JEDI-Skylab, GSI).
The spack-stack package is a collaborative effort between the NOAA Environmental Modeling Center (EMC), the UCAR Joint Center for Satellite Data Assimilation (JCSDA), and the Earth Prediction Innovation Center (EPIC). spack-stack is designed to support the various applications of the supporting agencies such as the Unified Forecast System (UFS) or the Joint Effort for Data assimilation Integration (JEDI).
Documentation for installing and using spack-stack can be found here: https://spack-stack.readthedocs.io/en/1.3.1/
New This Release
This is a bug fix release on top of V1.3.0:
- Downgrade hdf5 from 1.14.0 to 1.12.2 and py-h5py from 3.7.0 to 3.6.0
- New versions of eckit, fckit, ecmf-atlas, crtm, odc, gsibec, crtm
- Add missing jedi-mpas-env to unified environment
- Remove ufs-weather-model~debug from several templates