Hierarchical data file management #20
Description
Experiments should have automatic methods for handling files and those files should be structured consistently. Working with hive-partitioned data sets will make the most sense. Structuring the data with inputs in a seaprate folder, rather than stored underneath the data of a particular simulation, will also be more clear for traversing file management systems.