v0.20.2-arabica

This patch brings numerous fixes to the sampling protocol, particularly Bitswap sub-protocol dependency, by fixing 7(!) client-side memory leaks. It also improves resource utilization and load balancing on the server side. All the changes are currently applied in our fork(https://github.com/celestiaorg/boxo/tree/fixes) and will be upstreamed with unforking in an upcoming release.

Additionally, the patch applies a safety measure by temporarily disabling QUIC due to the unknown origin of the following bug: quic-go/quic-go#4712.

As a cherry on top, this patch hotfixes long-standing memory issues in BNs: #3926. Thanks to @rach-id for helping us with the debugging.

Full Changelog: v0.20.1-arabica...v0.20.2-arabica

v0.20.1-mocha

What's Changed

• deps(go.mod): bump app to arabica tag by @renaynay in #3910
• chore: bump to celestia-app v3.0.0-mocha by @evan-forbes in #3920

Full Changelog: v0.20.0-mocha...v0.20.1-mocha

v0.20.1-arabica

What's Changed

• ci(docker): bump version by @tty47 in #3914
• deps(go.mod): bump app to arabica tag by @renaynay in #3910

Full Changelog: v0.20.0-arabica...v0.20.1-arabica

v0.20.0-mocha

It's the equivalent of https://github.com/celestiaorg/celestia-node/releases/tag/v0.20.0-arabica but for Mocha and with a docker fix.

What's Changed

• ci(docker): bump version by @tty47 in #3914

Full Changelog: v0.20.0-arabica...v0.20.0-mocha

v0.20.0-arabica

This release breaks APIs and storage. The API break renames a method(#3902), grouping it closer to breaks in v0.19.0.

The storage break affects only LNs (#3887) and is necessary to support LN pruning post-Shwap. LN runners must resync their nodes. See the docs for further instruction.

Besides, this release brings multiple preventive improvements to sampling logic.

What's Changed(since v0.19.0-arabica)

Breaking

• !refactor: rename GetSharesByNamespace to GetNamespaceData by @cristaloleg in #3902
• feat(share/availability)!: Store success results for light availability by @walldiss in #3887

Feat

• feat(pruner/light): add light pruning for shwap by @walldiss in #3896

Fixes

• fix(pruner): fix find algo so that it does not pass a malformed range into GetRangeByHeight call by @renaynay in #3828
• fix: wrong network error by @jcstein in #3885
• fix(share/availability): propagate errors from light availability properly by @walldiss in #3888
• fix(shwap/shrex): enable recovery middleware in shrex server by @walldiss in #3897
• fix(DASer): Log sampling errors in DASer by @walldiss in #3889
• fix(availability): prevent parallel availability calls by @walldiss in #3883
• fix(ci): GH_TOKEN for upload-docs by @cristaloleg in #3877
• fix(ci): do not version_bump by @cristaloleg in #3882

Chores

• chore(share): remove unused ShareWithProof by @cristaloleg in #3893
• chore: remove unused code by @walldiss in #3898
• test(swamp): cover v1 blobs in swamp tests by @vgonkivs in #3908
• refactor(share/availability): simplify light availability by @walldiss in #3895

Full Changelog: v0.19.0-arabica...v0.20.0-arabica

v0.19.0-arabica

This release is API-breaking and contains an upgrade to the celestia-app version (to v3).

Notable API breaks include:

• deduplication of types that resulted in several type changes in the blob, share and state modules (via #3782)
• share module now takes height instead of the full ExtendedHeader (via #3870)

What to look out for in following releases:

• the --experimental-pruning flag will soon be deprecated in favour of pruning becoming the default mode for all node types, requiring users to pass --archival in order to retain block history beyond the sampling window
• the API gateway will be deprecated

What's Changed

• fix(nodebuilder): flag parsing for --node.type needs lowercase string, list network aliases for --p2p.network by @renaynay in #3827
• fix(share/p2p/bitswap): lower bitswap log severity by @walldiss in #3831
• chore(go.mod): Bump celestia-app to v2.2.0 release in main by @renaynay in #3826
• fix(store): check if link exists on write by @walldiss in #3844
• chore: remove some TODOs by @cristaloleg in #3810
• chore: bump to v2.3.0 by @evan-forbes in #3854
• fix(eds/cache): Fix prealloc for proof nodes by @walldiss in #3860
• feat(modp2p): close peer connections after successful blocking by @notlelouch in #3838
• feat(shwap/bitswap): use new option for optimized Has check by @Wondertan in #3813
• feat(store): Test all put funcs by @walldiss in #3847
• feat(store): use use relative path for empty blocks symlinks by @walldiss in #3861
• fix(store/cache): unstick cache metrics names by @walldiss in #3857
• fix(docs) update txResponse in docs by @walldiss in #3848
• refactor(store): write actual share size to ods by @walldiss in #3863
• fix(store/file): wait for q4 to be written before returning by @walldiss in #3865
• feat(store): correct corrupted files on write by @walldiss in #3859
• fix(ci,release): run on any new tag or trigger manually by @cristaloleg in #3855
• chore(ci): remove release tracking epic ci by @MSevey in #3866
• fix(share/ipld): use bits.Len64 instead of math.Log2 in newProofCollector by @notlelouch in #3867
• refactoring!(share): migrating to go-square v2 types by @vgonkivs in #3782
• chore(go.mod): bump header by @renaynay in #3872
• fix(nodebuilder/p2p): lint by @cristaloleg in #3875
• refactor(nodebuilder): add archival flag by @walldiss in #3868
• refactor(api): add gateway deprecation notice by @walldiss in #3869
• !refactor(api/share): use height in share module by @walldiss in #3870

New Contributors

• @notlelouch made their first contribution in #3838

Full Changelog: v0.18.2-arabica...v0.19.0-arabica

v0.18.3-mocha

This release is part of the ongoing Shwap Mocha migration period and is not backwards compatible with version 0.17. For more information about Shwap, please refer to the Shwap Mocha Migration Details.

Important Notice:

• This release includes changes to the symlinks used by Full and Bridge nodes. While it maintains backwards compatibility with version 0.18.2, performing the migration is optional but highly recommended.
• To migrate, please use the migration script.
  • Usage: migrate_links.sh %path_to_store%

This update also includes multiple bug fixes, performance improvements, and new features to enhance the celestia-node. Please refer to the attached changelog for full details.

What's Changed

• fix(nodebuilder): flag parsing for --node.type needs lowercase string, list network aliases for --p2p.network by @renaynay in #3827
• fix(share/p2p/bitswap): lower bitswap log severity by @walldiss in #3831
• chore(go.mod): Bump celestia-app to v2.2.0 release in main by @renaynay in #3826
• fix(store): check if link exists on write by @walldiss in #3844
• chore: remove some TODOs by @cristaloleg in #3810
• chore: bump to v2.3.0 by @evan-forbes in #3854
• fix(eds/cache): Fix prealloc for proof nodes by @walldiss in #3860
• feat(modp2p): close peer connections after successful blocking by @notlelouch in #3838
• feat(shwap/bitswap): use new option for optimized Has check by @Wondertan in #3813
• feat(store): Test all put funcs by @walldiss in #3847
• feat(store): use use relative path for empty blocks symlinks by @walldiss in #3861
• fix(store/cache): unstick cache metrics names by @walldiss in #3857
• fix(docs) update txResponse in docs by @walldiss in #3848
• refactor(store): write actual share size to ods by @walldiss in #3863
• fix(store/file): wait for q4 to be written before returning by @walldiss in #3865
• feat(store): correct corrupted files on write by @walldiss in #3859
• fix(ci,release): run on any new tag or trigger manually by @cristaloleg in #3855

New Contributors

• @notlelouch made their first contribution in #3838

Full Changelog: v0.18.2-mocha...v0.18.3-mocha

v0.17.2

What's changed

• chore: bump to v2.3.0 by @evan-forbes in #3854

Full Changelog: v0.17.1...v0.17.2

v0.17.1

This release contains an API-breaking change to the DA API via #3750

What's Changed

• chore(swamp): skip fraud test until a better day by @Wondertan in #3712
• chore(go.mod): use toolchain version in go.mod by @walldiss in #3714
• fix(logs): bitswap logger names broke in latest version bump, updated by @renaynay in #3713
• chore(p2p/shrexsub) increase timeout for flaky shrexsub test by @walldiss in #3672
• chore(ci): run unit-tests in parallel with lint by @walldiss in #3700
• feat(modrpc): list pubsub topics RPC by @Wondertan in #3744
• fix(blob/service): return error from GetProof if it appears by @vgonkivs in #3742
• chore: use sync/atomic types by @cristaloleg in #3723
• Add bootsrapper for mainnet by Qubelabs by @qubelabsio in #3760
• Add bootstrapper mainnet P-OPS by @rooiie in #3749
• Chore(fix): set asynctimerchan=1 on build by @walldiss in #3761
• fix(ci): Run pruning integration test separately in ci by @walldiss in #3752
• log(das): clarify that square width is for EDS by @renaynay in #3725
• fix(nodebuilder/host): Ensure libp2p metrics are collected to prometheus by @walldiss in #3753
• fix(nodebuilder/p2p/metrics): enforce init order for bitswap metrics by @walldiss in #3763
• fix(node): fixup CELESTIA_HOME by @Wondertan in #3759
• feat: add network-specific tags to ci container workflow by @smuu in #3765
• chore(ci): add workflow dispath to docker ci to manually trigger by @MSevey in #3766
• chore(backport): backport changes from main to v0.16.1 release branch by @walldiss in #3776
• bump go-da by @tzdybal in #3750
• chore(deps): upgrade to v2.2.0-mocha by @rootulp in #3786
• chore(deps): upgrade to app v2.2.0 by @rootulp in #3809

Full Changelog: v0.16.0...v0.17.1

v0.17.1-mocha

What's Changed

• chore(deps): upgrade to app v2.2.0 by @rootulp in #3809

Full Changelog: v0.17.0-arabica...v0.17.1-mocha