Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Global checkpointing dir. Default: Temporary #92

Open
wants to merge 14 commits into
base: development
Choose a base branch
from

Conversation

PascalIversen
Copy link
Collaborator

@PascalIversen PascalIversen commented Dec 6, 2024

new parameter for the run_suite, drug_response_experiment and DRPModel.train: model_checkpoint_dir. By default this is a temporary dir to prevent accumulation of too many checkpoints.

Closes #91

@JudithBernett
Copy link
Contributor

Please try if this works with the pipeline:

  1. On the server, pull this Git, create an environment, checkout this branch, install this current version with pip install -e .
  2. Pull the current version of the nextflow pipeline, checkout the dev branch
  3. Run the nf-core pipeline with one of the models that writes checkpoint files: nextflow run . --models [model-of-your-choice] --dataset_name Toy_Data --path_data [path-to-data] -c [your-config]
  4. After the process TRAIN_AND_PREDICT_CV was run, find out to which work directory the results were written
  5. Look in the work directory in verify that it doesn't look like this (i.e., that the checkpoints were deleted):
    Bildschirmfoto 2024-12-12 um 16 47 23

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Default checkpointing should happen in temp directory
2 participants