Skip to content

[feat] Enable launchers to forward environment variables #3464

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: develop
Choose a base branch
from

Conversation

jack-morrison
Copy link
Contributor

@jack-morrison jack-morrison commented Apr 10, 2025

Support for environment variable forwarding is added to the srun launcher, as well as two new launchers mpirun-openmpi and mpirun-intelmpi.

Closes #3207.

References:

@jack-morrison jack-morrison requested a review from vkarak April 10, 2025 15:10
@jack-morrison jack-morrison self-assigned this Apr 10, 2025
@jack-morrison jack-morrison marked this pull request as draft April 10, 2025 15:21
@jack-morrison jack-morrison force-pushed the jackm/launcher-fwd-env-vars branch from ab34480 to ee90103 Compare April 10, 2025 15:24
@jack-morrison jack-morrison marked this pull request as ready for review April 10, 2025 15:29
Support for environment variable forwarding is added
to the srun launcher, as well as two new launchers
(mpirun-openmpi, mpirun-intelmpi).

Signed-off-by: Jack Morrison <[email protected]>
Copy link
Contributor

@vkarak vkarak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mostly style comments. We would also need to update the general docs about launchers here:

.. py:attribute:: systems.partitions.launcher

Where we need to add the new launchers.

@github-project-automation github-project-automation bot moved this from Todo to In Progress in ReFrame Backlog Apr 28, 2025
@jack-morrison
Copy link
Contributor Author

jack-morrison commented Apr 30, 2025

I believe I've addressed all review comments via 4166dcf, but still need to manually retest the launcher behaviors with this commit.

Copy link
Contributor

@vkarak vkarak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We still need to add the new launchers in the configuration docs.

#: - ``srun``
#: - ``mpirun-openmpi``
#: - ``mpirun-intelmpi``
#:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add also a .. versionadded:: 4.9 annotation here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: In Progress
Development

Successfully merging this pull request may close these issues.

Feature request: support for exporting environment variables with parallel launchers
2 participants