You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If we bump up our support to newer HDF5 versions, then we can optimize meta-data features & performance:
The call H5Pset_libver_bounds will set the guaranteed compatibility with older readers. The less old versions are supported, the more performant we can be.
Cool features in Quincy Koziol's ATPESC23 or HUG23 slides (to be linked):
size of metadata structures H5Pset_istore_k, H5Pset_sym_k, etc.
metadata aggregation in larger blocks H5Pset_meta_block_size
Align objects in the file H5Pset_alignment
Metadata cache size
Page allocation and page buffering (see: File Space management)
We got to check, but can probably dump everything before 1.12 because our users & readers use recent pip/conda packages that mostly ship HDF5 1.14 already.
cc @jeanbez already increased quite a few of these buffers, but I was unaware of H5Pset_libver_bounds performance implications so far.
The text was updated successfully, but these errors were encountered:
@ax3l let me know the minimum version you plan to support so I can open a PR with this. I can check the other optimizations since most have already been applied. I'm curious about their possible impact on openPMD.
If we bump up our support to newer HDF5 versions, then we can optimize meta-data features & performance:
The call
H5Pset_libver_bounds
will set the guaranteed compatibility with older readers. The less old versions are supported, the more performant we can be.Cool features in Quincy Koziol's ATPESC23 or HUG23 slides (to be linked):
H5Pset_istore_k
,H5Pset_sym_k
, etc.H5Pset_meta_block_size
H5Pset_alignment
We got to check, but can probably dump everything before 1.12 because our users & readers use recent pip/conda packages that mostly ship HDF5 1.14 already.
cc @jeanbez already increased quite a few of these buffers, but I was unaware of
H5Pset_libver_bounds
performance implications so far.The text was updated successfully, but these errors were encountered: