Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nexus_post_split job failed with NEI2019 and AQM_NA_9km grids #69

Closed
JianpingHuang-NOAA opened this issue Feb 5, 2025 · 12 comments · Fixed by #71 · May be fixed by #70
Closed

nexus_post_split job failed with NEI2019 and AQM_NA_9km grids #69

JianpingHuang-NOAA opened this issue Feb 5, 2025 · 12 comments · Fixed by #71 · May be fixed by #70
Labels
bug Something isn't working

Comments

@JianpingHuang-NOAA
Copy link
Contributor

The nexus_post_split job failed with the following error message


PROGRAM: combine_ant_bio.py
Starting...

mapping species AACD
Traceback (most recent call last):
File "/lfs/h2/emc/physics/noscrub/jianping.huang/nwdev/packages/aqm.v8.0.0h/sorc/arl_nexus/utils/combine_ant_bio.py", line 201, in
raise SystemExit(main(**parse_args()))
File "/lfs/h2/emc/physics/noscrub/jianping.huang/nwdev/packages/aqm.v8.0.0h/sorc/arl_nexus/utils/combine_ant_bio.py", line 116, in main
ds_new[spc][:] = ds["InvMEGAN_AAXX"][:]
File "src/netCDF4/_netCDF4.pyx", line 2386, in netCDF4._netCDF4.Dataset.getitem
IndexError: InvMEGAN_AAXX not found in /
PBS: Running epilogue on parent mom node: nid001088...

Job 6448498.dbqs01 - PBS Job Script:

(Note: Duplicate #PBS entries are a function how PBS interprets and caches the original job script.)

@zmoon
Copy link
Member

zmoon commented Feb 5, 2025

Thanks @JianpingHuang-NOAA for reporting this.

It looks like the issue is that those diagnostics were removed for HEMCO v3.9.2 release. We need to specify them in the HEMCO_Diagn.rcs instead.

@JianpingHuang-NOAA
Copy link
Contributor Author

@zmoon Let me know if it is ready for a test. Thanks !

@zmoon
Copy link
Member

zmoon commented Feb 6, 2025

@JianpingHuang-NOAA we're still figuring out what we should do. Our first idea didn't work (Patrick tested). Will let you know.

@JianpingHuang-NOAA
Copy link
Contributor Author

@zmoon Dogwood was down today. I will test it when the machine is up.

@JianpingHuang-NOAA
Copy link
Contributor Author

@zmoon The job still failed with the same error message after adding the following three lines in the "HEMCO_sa_Diagn.rc" at
~/parm/nexus_config/cmaq_nei2019

InvMEGAN_AAXX AAXX 108 -1 -1 2 kg/m2/s
InvMEGAN_FAXX FAXX 108 -1 -1 2 kg/m2/s
InvMEGAN_APIN APIN 108 -1 -1 2 kg/m2/s

@zmoon zmoon mentioned this issue Feb 6, 2025
@zmoon
Copy link
Member

zmoon commented Feb 6, 2025

Hi @JianpingHuang-NOAA, we're still working out how to get those outputs working with HEMCO 3.10. In the meantime could you try #71, which reverts HEMCO to 3.9.1? Note that git submodule update --recursive or such will be needed after switching to that branch.

@JianpingHuang-NOAA
Copy link
Contributor Author

JianpingHuang-NOAA commented Feb 6, 2025

@zmoon I did :git submodule update" and then recompiled the nexus code, and still got the following error message,


PROGRAM: combine_ant_bio.py
Starting...

mapping species AACD
Traceback (most recent call last):
File "/lfs/h2/emc/physics/noscrub/jianping.huang/nwdev/packages/aqm.v8.0.0h/sorc/arl_nexus/utils/combine_ant_bio.py", line 201, in
raise SystemExit(main(**parse_args()))
File "/lfs/h2/emc/physics/noscrub/jianping.huang/nwdev/packages/aqm.v8.0.0h/sorc/arl_nexus/utils/combine_ant_bio.py", line 116, in main
ds_new[spc][:] = ds["InvMEGAN_AAXX"][:]
File "src/netCDF4/_netCDF4.pyx", line 2386, in netCDF4._netCDF4.Dataset.getitem
IndexError: InvMEGAN_AAXX not found in /
PBS: Running epilogue on parent mom node: nid002735...

Job 6547999.dbqs01 - PBS Job Script:

(Note: Duplicate #PBS entries are a function how PBS interprets and caches the original job script.)
"

@zmoon
Copy link
Member

zmoon commented Feb 6, 2025

Can you check what HEMCO commit you have? I did a test run and did get those outputs using #71

@JianpingHuang-NOAA
Copy link
Contributor Author

I checked out a fresh develop branch from https://github.com/noaa-oar-arl/NEXUS
, and still seeing

commit deaa1923f3d3e06e264c4ccbe0e3b7dc32edcc20
Merge: 41605bd b88ff92
Author: Bob Yantosca [email protected]
Date: Fri Nov 8 12:31:27 2024 -0500

**HEMCO 3.10.0 release**

@zmoon
Copy link
Member

zmoon commented Feb 6, 2025

#71 hasn't been merged to the develop branch yet (waiting for Patrick to check if it fixes the issue). You'd have to check out the corresponding branch.

@JianpingHuang-NOAA
Copy link
Contributor Author

It works with HEMCO 3.9.1

@drnimbusrain
Copy link
Member

Yes confirmed that it works on WCOSS2, closing this issue.

@zmoon zmoon linked a pull request Feb 7, 2025 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
3 participants