Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

benchpark mirror #620

Open
wants to merge 18 commits into
base: develop
Choose a base branch
from
Open

benchpark mirror #620

wants to merge 18 commits into from

Conversation

scheibelp
Copy link
Collaborator

@scheibelp scheibelp commented Feb 15, 2025

Closes #566

Say you did:

bin/benchpark experiment init --dest=def-raja-perf raja-perf
bin/benchpark system init --dest=def-ruby llnl-cluster cluster=ruby compiler=gcc
bin/benchpark setup raja-perf-default/ def-ruby/ workspace/
. `pwd`/workspace/setup.sh
ramble --disable-progress-bar --workspace-dir `pwd`/workspace/def-raja-perf/def-ruby/workspace workspace setup

(an example of a typical benchmark workflow that sets up an experiment to run)

Then you can

bin/benchpark mirror create `pwd`/workspace/def-raja-perf/def-ruby/workspace/ test-benchpark-mirror/

move test-benchpark-mirror somewhere, and run

(with test-benchpark-mirror as the CWD)
python3 -m venv mirror-env; . mirror-env/bin/activate
pip install --no-index --find-links=pip-cache pip-cache/*
. `pwd`/setup.sh
ramble --disable-progress-bar --workspace-dir `pwd`/def-raja-perf/def-ruby/workspace/ workspace setup

(note this only provides enough resources in test-benchpark-mirror to run Ramble and Spack, not benchpark itself - doing so would typically not be useful)

@pearce8 pearce8 requested a review from becker33 February 17, 2025 03:00
@scheibelp scheibelp changed the title [WIP] benchpark mirror benchpark mirror Feb 19, 2025
@scheibelp
Copy link
Collaborator Author

I'm removing WIP because I can now run the destination-side commands listed above in the description.

Copy link
Collaborator

@pearce8 pearce8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add documentation on how to use the mirror capability.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Benchpark mirror
2 participants