Shwap hardening and optimizations tracking issue

[walldiss]

Implementation ideas

This issue will collect small improvements that remain after merging features to the shwap. Most have low priority, while others are planned for subsequent PRs and mentioned here to keep them tracked.

ODS file:

• rename square to quadrant. Planned for Q1Q4 file PR
• readODS benchmarking. Need to find optimal size for buffer used to read full ODS. Compare buffered read vs reading allocating single array for full ODS. @Wondertan
• computeAxisHalf: Add more comment on actual algo(selection of opposite axes, usage reconstructSome, etc). Support it with visual diagram of computed axis.
• fill ods field with data from eds. Planned for improving memory alloc in ODS file PR
• codec should be removed. Planned after support for reconstructSome is added to rsmt2d.
• header de/serialization funcs of should be fuzzed.

Q1Q4:

• cache proofs on shrex recompute eds and use them to populate cache file. It will make proofs available in recent cache
• Add option to AxisHalf method of Accessor to be able to read Q4 on file store

Store:

• Storage should use eds.Accessor as input for Put().
• Add support for reducing of Q1Q4file to ODSfile, when they move outside of sampling window.
• Disallow serving samples outside of sampling window. Can be done by implementing Prunned AccessorGetter inside prunner pkg. Wrapper over AccessorGetter, that will wrap every Accessor with one, that do not allow getting samples from archival heights.

Misc:

• CacheAccessor to deduplicate cached shares across perpendicular axises.
  • Not a priority because Сols are only read during reconstruction
• Use NMT/Rsmt2s native caching once implemented
  • Currently we rely on Blockstore and CIDs for that
  • Allows us to drop IPLD pkg entirely
• Bitswap Composition
  • Notify Bitswap about newly stored Shwap containers.
  • Ensure Blockstore GetSize calls followed by Get reuse the same allocated Blocks
  • Protection from requests getting over server limits
    • Relevant bitswap/server: wantlist overflows fails in a toxic maner preventing any data transfer ipfs/boxo#527 and fix: wantlist overflow handling to select newer entries ipfs/boxo#629 (comment)
• Prefer DataRoot over DataHash to be consistent with naming in the core

Spec:

• Define NamespaceData container and id
• Proof-only mode for RowNamespaceData, NamespaceData, maybe Sample?
• Define protocol IDs for bitswap composition
• [ } Add shrex as composition