Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is docker a real dependency? #3

Open
AsierGonzalez opened this issue Apr 13, 2021 · 8 comments
Open

Is docker a real dependency? #3

AsierGonzalez opened this issue Apr 13, 2021 · 8 comments
Assignees
Labels
bug Something isn't working

Comments

@AsierGonzalez
Copy link
Collaborator

AsierGonzalez commented Apr 13, 2021

According to the README docker is a dependency of the wrapper. Moreover, VRE_RUNNER checks whether it is installed. However, disabling this check and running the executor works fine so I suspect docker is not really a dependency.

  • Is it only required to run the basic test in /tests/basic? If so, I suggest we stop considering it a dependency.
@lrodrin
Copy link
Collaborator

lrodrin commented Apr 14, 2021

Deleted docker dependency in VRE_RUNNER and README files.

@lrodrin lrodrin closed this as completed Apr 14, 2021
@jmfernandez
Copy link
Member

One question, are workflows run by this runner depending on singularity or on docker images?

@AsierGonzalez
Copy link
Collaborator Author

Do you mean if all the workflows must have DockerRequirement set?

@jmfernandez
Copy link
Member

jmfernandez commented Apr 14, 2021

I have had a look at the code, and as cwltool is run with no --singularity or --no-container flag, it is assumed it is going to delegate on docker for workflow steps execution when a defined DockerRequirement is found

@jmfernandez jmfernandez reopened this Apr 14, 2021
@AsierGonzalez
Copy link
Collaborator Author

We are working on that. We have agreed that we will be using singularity to run the containers but the feature hasn't been implemented in main yet since @lrodrin is refactoring it first. We have added it to the ag_neuroplat_hacks and we'll be porting it soon.

@AsierGonzalez
Copy link
Collaborator Author

Having said that. I now suspect that we will not be able to get rid of docker as a dependency completely, since using JavaScript Expressions requires either Node.js or docker to be available. I don't know how common this feature is but it is used by the basic test.

@jmfernandez
Copy link
Member

Having said that. I now suspect that we will not be able to get rid of docker as a dependency completely, since using JavaScript Expressions requires either Node.js or docker to be available. I don't know how common this feature is but it is used by the basic test.

Ewwwww, that's a nasty dependency!!!! I have had a look at cwltool code, and I could not believe my eyes

https://github.com/common-workflow-language/cwltool/blob/e37134a90ac7a7c18254e30cff16da590b45c6d7/cwltool/sandboxjs.py#L80-L125

Thanks for the insight!

@AsierGonzalez
Copy link
Collaborator Author

I've spent a couple of hours today trying to figure out why the execution crashed asking me to install Node.js if I wanted to run js... 😞

@lrodrin lrodrin removed their assignment Aug 2, 2021
@lrodrin lrodrin added the bug Something isn't working label Sep 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants