Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Time processing with files uploaded to nfs / node disk #34

Open
katilp opened this issue Jul 18, 2024 · 0 comments
Open

Time processing with files uploaded to nfs / node disk #34

katilp opened this issue Jul 18, 2024 · 0 comments

Comments

@katilp
Copy link
Contributor

katilp commented Jul 18, 2024

After #31:

Time the processing step in two cases:

  • read from the mounted nfs
  • copy the files from the mounted nfs to the node disk before starting the processing

In the latter case, take note of the available disk space on the node and the file sizes, some example sizes:

-rw-r--r--   2 cmsrucio def-cg         2.48 G Nov 19  2023 0064D80E-4FDC-5B4C-9331-194B5177E872.root
-rw-r--r--   2 cmsrucio def-cg         3.67 G Nov 19  2023 02AC3E42-B582-B143-BDB3-96FEB624CFDD.root
-rw-r--r--   2 cmsrucio def-cg         3.82 G Nov 19  2023 044AD6DB-5CB0-1145-822A-753568C3AA74.root
-rw-r--r--   2 cmsrucio def-cg         4.08 G Nov 19  2023 07AB6151-D056-D44B-BEFC-F7A7B61DEBA2.root
-rw-r--r--   2 cmsrucio def-cg         3.53 G Nov 19  2023 0A63609D-D6C5-3040-B60B-060E0A63C4CF.root
-rw-r--r--   2 cmsrucio def-cg         3.20 G Nov 19  2023 0A7116E0-5F7D-6742-83AC-5FA5328E315C.root
-rw-r--r--   2 cmsrucio def-cg         3.51 G Nov 19  2023 0B3604A5-9CDA-D948-9D5F-54BDE40AD933.root
-rw-r--r--   2 cmsrucio def-cg         3.08 G Nov 19  2023 0BA71C33-7858-E648-B326-F9893D730F28.root

Compare the timing with the previous workflow streaming from eospublic

@katilp katilp changed the title Time processing with file uploaded to nfs / node disk Time processing with files uploaded to nfs / node disk Jul 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

1 participant