nightly

Automated nightly release, will be updated every day at 20:00 UTC

1.3.2-rc0

What's Changed

• perf(produce): fix validate compressed records alloc too many memory by @superhx in #2257
• chore(version): bump version to 1.3.2-rc0 by @superhx in #2260

Full Changelog: 1.3.1...1.3.2-rc0

1.3.1

What's Changed

• feat(table): enhance command utils by @superhx in #2217
• fix(tools/perf): fix the perf tools await count by @superhx in #2220
• feat(tools/perf): support schema message perf by @superhx in #2227
• feat(telemetry): support gzip compression on uploading metrics & logs… by @SCNieh in #2222
• fix(core): fix potential infinite recursion on reading empty segment by @SCNieh in #2229
• feat(version): bump to 1.3.1-rc0 by @superhx in #2234
• feat: support backpressure by @Chillax-0v0 in #2236
• feat(table): cherry table topic aspect by @superhx in #2237
• feat(stream): exponential backoff retry by @superhx in #2239
• feat(config): add table topic conversion type configuration (#2203) by @Gezi-lzq in #2240
• fix(s3stream): report compaction delay after two compaction period by @SCNieh in #2242
• feat(tools/perf): user experience optimization by @Chillax-0v0 in #2244
• feat(table): support partition & upsert config by @superhx in #2248
• chore(config): change s3.stream.object.compaction.max.size.bytes default value from 1GiB to 10GiB by @superhx in #2250
• fix(cli/deploy): override "controller.quorum.bootstrap.servers" by @Chillax-0v0 in #2252
• chore(version): bump version to 1.3.1 by @Chillax-0v0 in #2254

Full Changelog: 1.3.0...1.3.1

1.2.2-rc0

What's Changed

• chore(github): update code owners by @Chillax-0v0 in #2157
• fix(stream): release FetchResults if the subsequent fetch fails by @Chillax-0v0 in #2175
• fix: release PooledMemoryRecords if it's dropped in the fetch session by @Chillax-0v0 in #2188
• fix: use the "adjusted" maxSize in ElasticLogSegment#readAsync by @Chillax-0v0 in #2191
• fix(issues2193): retry 2 times to cover most of BlockNotContinuousException by @superhx in #2196
• fix(docker): use bucket url by @superhx in #2214
• feat(telemetry): support gzip compression on uploading metrics & logs… by @SCNieh in #2224
• fix(core): fix potential infinite recursion on reading empty segment by @SCNieh in #2231
• feat(gradle): bump version to 1.2.2-rc0 by @superhx in #2245

Full Changelog: 1.2.1...1.2.2-rc0

1.3.1-rc1

What's Changed

• feat: support backpressure by @Chillax-0v0 in #2236
• feat(table): cherry table topic aspect by @superhx in #2237
• feat(stream): exponential backoff retry by @superhx in #2239
• feat(config): add table topic conversion type configuration (#2203) by @Gezi-lzq in #2240
• fix(s3stream): report compaction delay after two compaction period by @SCNieh in #2242

Full Changelog: 1.3.1-rc0...1.3.1-rc1

1.3.1-rc0

What's Changed

• feat(table): enhance command utils by @superhx in #2217
• fix(tools/perf): fix the perf tools await count by @superhx in #2220
• feat(tools/perf): support schema message perf by @superhx in #2227
• feat(telemetry): support gzip compression on uploading metrics & logs… by @SCNieh in #2222
• fix(core): fix potential infinite recursion on reading empty segment by @SCNieh in #2229
• feat(version): bump to 1.3.1-rc0 by @superhx in #2234

Full Changelog: 1.3.0...1.3.1-rc0

1.3.0-rc2

What's Changed

• fix(stream): release FetchResults if the subsequent fetch fails by @Chillax-0v0 in #2174
• feat(core): reuse unregistered node when requesting for next node id by @SCNieh in #2183
• fix: release PooledMemoryRecords if it's dropped in the fetch session by @Chillax-0v0 in #2187
• fix: use the "adjusted" maxSize in ElasticLogSegment#readAsync by @Chillax-0v0 in #2190
• fix(issues2193): retry 2 times to cover most of BlockNotContinuousException by @superhx in #2195
• fix(core): fix getting duplicated node id by @SCNieh in #2199
• fix(core): write next node id into image by @SCNieh in #2205
• feat(version): bump version to 1.3.0-rc2 by @SCNieh in #2211

Full Changelog: 1.3.0-rc1...1.3.0-rc2

1.3.0

What's Changed

• fix(s3stream): fix deadlock issue by @ShadowySpirits in #1808
• fix(e2e): adaptation to pr: #1794 by @llzcx in #1809
• feat(shell): new consumer in pref command should start consuming from the beginning by @ShadowySpirits in #1812
• fix(metadata): fix sparse index serialization capacity by @SCNieh in #1814
• chore(logger): move trim log to broker by @superhx in #1819
• chore(workflows): e2e support release runner by @superhx in #1825
• chore(config): change quorum default timeout to 5s by @superhx in #1823
• fix(s3strea/wal): handle IOException during flushing WAL header by @Chillax-0v0 in #1827
• chore(workflows): add e2e base image release by @superhx in #1830
• fix(test): fix rolling_update_test e2e by @superhx in #1835
• feat(s3stream): add AsyncLRUCache metric by @lifepuzzlefun in #1829
• fix(s3stream): fix storage failure handle deadlock by @superhx in #1838
• fix(s3stream/wal): fail all IO operations once the WAL is failed by @Chillax-0v0 in #1840
• feat(metadata): limit the size of sparse index cache by @SCNieh in #1832
• feat(issues1842): cleanup metastream kv after deleting topic by @superhx in #1843
• fix(s3stream): error callback by @superhx in #1845
• fix(revert): error callback by @superhx in #1851
• feat(metadata): avoid serialize empty index by @SCNieh in #1852
• feat(metadata): limit sparse index cache update interval by @SCNieh in #1847
• feat(s3stream): support call #close(force=true) after #close(force=false) by @superhx in #1854
• feat(metadata): prune invalid sparse index with image on startup by @SCNieh in #1856
• feat(s3stream): add network rate limiter for s3 wal to export metrics by @ShadowySpirits in #1859
• feat(s3stream): change the checksum algorithm to crc32c by @ShadowySpirits in #1860
• feat(s3stream): support change checksum algorithm by @ShadowySpirits in #1863
• feat(e2e): use cloud vms for e2e tests; move wal path by @mooc9988 in #1862
• fix(e2e): always archive result artifacts by @mooc9988 in #1866
• fix(storage): regard all produce requests as duplicate whose sequence… by @Chillax-0v0 in #1865
• revert: enable LocalStreamRangeIndexCacheTest#testEvict by @Chillax-0v0 in #1869
• feat(wal): failoverTest optimization by @CLFutureX in #1871
• fix(metadata): catch exception to prevent unnecessary error log by @SCNieh in #1872
• perf(s3stream): check the logger level before trace and debug by @Chillax-0v0 in #1875
• perf(s3stream/wal): reuse the ByteBuf for record headers by @Chillax-0v0 in #1877
• perf(s3stream/wal): increase the size of the buffer pool as CPU cores by @Chillax-0v0 in #1882
• chore(tools/perf): increase the message sending rate during the warmup to accelerate JVM warmup by @Chillax-0v0 in #1883
• test(metadata/image): thread sync issue by @Pey-crypto in #1879
• fix(test): fix consumer mode e2e by increase timeout by @superhx in #1885
• feat(issue1462): add user case. by @vintagewang in #1889
• fix(e2e): fix bug by @llzcx in #1891
• chore(logger): change e2e streams log level to INFO by @superhx in #1892
• perf(s3stream): optimize the critical section in s3 wal by @ShadowySpirits in #1880
• test(e2e): version upgrade test by @llzcx in #1822
• fix(s3stream/wal): fix memory leak by @Chillax-0v0 in #1896
• fix(e2e): fix data map format by @mooc9988 in #1898
• fix(metadata): fix sparse index leak on compaction split by @SCNieh in #1894
• fix(metadata): fix evict sparse index cache potential endless loop by @SCNieh in #1900
• feat(metadata): add metrics for sparse index cache monitor by @SCNieh in #1902
• fix(metadata): prevent concurrent uploading of local sparse index cache by @SCNieh in #1904
• fix(metadata): fix wrong stream number in serialization by @SCNieh in #1906
• feat(s3stream): add docs for checksumAlgorithm configuration by @ShadowySpirits in #1908
• fix(metadata): fix interrupted batch upload by @SCNieh in #1913
• perf(config): increase the default index interval from 4KiB to 1MiB by @Chillax-0v0 in #1915
• chore: add nightly release for automq by @daniel-y in #1916
• chore: polish the nightly release by @daniel-y in #1917
• chore: make the nightly release as a pre release by @daniel-y in #1918
• feat(s3stream): unify object not exist exception by @superhx in #1920
• fix(e2e): fix bug by @llzcx in #1922
• feat(s3stream): limit the inflight fast retry request count by @ShadowySpirits in #1919
• feat(eventLoop): the visibility of the shutdown flag for the event loop and optimizations for graceful shutdown by @CLFutureX in #1796
• chore(test): set runner to e2e by @superhx in #1929
• chore(telemetry): set the endpoint of otlp receiver manually by @Chillax-0v0 in #1927
• feat(metadata): expire node sparse index cache after write by @SCNieh in #1925
• feat(auto_balancer): limit the max number of nodes to reassign partit… by @SCNieh in #1933
• feat(metadata): blocking wait for uploading local index cache on stre… by @SCNieh in #1931
• feat(readme): add github trending logo by @vintagewang in #1936
• feat(s3stream): add checksum for s3 wal by @ShadowySpirits in #1939
• feat(s3stream): ensure compaction could be executed (#1935) by @superhx in #1937
• docs(s3stream/version): statement of features supported by S3Stream V1 by @Chillax-0v0 in #1943
• fix(s3stream): resolve unintended buffer reuse by @ShadowySpirits in #1945
• feat(s3stream): make s3client configuration can be override by @warr99 in #1947
• fix(s3stream): fix buffer leak by @ShadowySpirits in #1948
• fix(bufAlloc): adjust the default size by @CLFutureX in #1955
• perf(core): disable DeleteProduce tryComplete trace log by @lifepuzzlefun in #1951
• fix(s3stream): change reject handler to prevent task lost by @SCNieh in #1956
• feat(s3stream): change append callback thread number by @lifepuzzlefun in #1950
• feat(s3stream): support limit write bandwidth for WALBlockDeviceChannel by @lifepuzzlefun in #1941
• feat(readme): update aws marketplace url(#1936) by @vintagewang in #1958
• fix(issues1960): allow UNSET attributes for version 1.1 by @superhx in #1962
• build(dependencies): update Jackson to 2.17.1 by @warr99 in #1963
• feat(s3stream): add tail read throttle strategy by @SCNieh in #1965
• feat(wal): unOverCapacityException will lead to memory leaks by @CLFutureX in #1952
• perf(core): optimize FetchSession.update high memory allocate rate by @lifepuzzlefun in #1966
• perf(s3stream): optimize ByteBufAlloc.USAGE_STATS high cpu usage by @lifepuzzlefun in #1959
• fix(s3stream/wal): record metrics on WAL full by @Chillax-0v0 in #1968
• feat(s3stream): optimize recovery read throttle priority by @SCNieh in #1967
• Update README.md with new videos by @KaimingWan in #1969
• fix(log): use the same view to calculate trim offsets by @Chillax-0v0 in https://github.com...

1.3.0-rc1

What's Changed

• chore(github): update code owners by @Chillax-0v0 in #2156
• feat(tools/perf): create topics in batch by @Chillax-0v0 in #2165
• chore(workflow): add spotless check by @superhx in #2169
• fix(issue2151): avoid using stale broker IPs for AutoBalancer consume… by @SCNieh in #2177
• feat(version): bump version to 1.3.0-rc1 by @SCNieh in #2178

Full Changelog: 1.3.0-rc0...1.3.0-rc1

1.3.0-rc0

What's Changed

• fix(s3stream): fix deadlock issue by @ShadowySpirits in #1808
• fix(e2e): adaptation to pr: #1794 by @llzcx in #1809
• feat(shell): new consumer in pref command should start consuming from the beginning by @ShadowySpirits in #1812
• fix(metadata): fix sparse index serialization capacity by @SCNieh in #1814
• chore(logger): move trim log to broker by @superhx in #1819
• chore(workflows): e2e support release runner by @superhx in #1825
• chore(config): change quorum default timeout to 5s by @superhx in #1823
• fix(s3strea/wal): handle IOException during flushing WAL header by @Chillax-0v0 in #1827
• chore(workflows): add e2e base image release by @superhx in #1830
• fix(test): fix rolling_update_test e2e by @superhx in #1835
• feat(s3stream): add AsyncLRUCache metric by @lifepuzzlefun in #1829
• fix(s3stream): fix storage failure handle deadlock by @superhx in #1838
• fix(s3stream/wal): fail all IO operations once the WAL is failed by @Chillax-0v0 in #1840
• feat(metadata): limit the size of sparse index cache by @SCNieh in #1832
• feat(issues1842): cleanup metastream kv after deleting topic by @superhx in #1843
• fix(s3stream): error callback by @superhx in #1845
• fix(revert): error callback by @superhx in #1851
• feat(metadata): avoid serialize empty index by @SCNieh in #1852
• feat(metadata): limit sparse index cache update interval by @SCNieh in #1847
• feat(s3stream): support call #close(force=true) after #close(force=false) by @superhx in #1854
• feat(metadata): prune invalid sparse index with image on startup by @SCNieh in #1856
• feat(s3stream): add network rate limiter for s3 wal to export metrics by @ShadowySpirits in #1859
• feat(s3stream): change the checksum algorithm to crc32c by @ShadowySpirits in #1860
• feat(s3stream): support change checksum algorithm by @ShadowySpirits in #1863
• feat(e2e): use cloud vms for e2e tests; move wal path by @mooc9988 in #1862
• fix(e2e): always archive result artifacts by @mooc9988 in #1866
• fix(storage): regard all produce requests as duplicate whose sequence… by @Chillax-0v0 in #1865
• revert: enable LocalStreamRangeIndexCacheTest#testEvict by @Chillax-0v0 in #1869
• feat(wal): failoverTest optimization by @CLFutureX in #1871
• fix(metadata): catch exception to prevent unnecessary error log by @SCNieh in #1872
• perf(s3stream): check the logger level before trace and debug by @Chillax-0v0 in #1875
• perf(s3stream/wal): reuse the ByteBuf for record headers by @Chillax-0v0 in #1877
• perf(s3stream/wal): increase the size of the buffer pool as CPU cores by @Chillax-0v0 in #1882
• chore(tools/perf): increase the message sending rate during the warmup to accelerate JVM warmup by @Chillax-0v0 in #1883
• test(metadata/image): thread sync issue by @Pey-crypto in #1879
• fix(test): fix consumer mode e2e by increase timeout by @superhx in #1885
• feat(issue1462): add user case. by @vintagewang in #1889
• fix(e2e): fix bug by @llzcx in #1891
• chore(logger): change e2e streams log level to INFO by @superhx in #1892
• perf(s3stream): optimize the critical section in s3 wal by @ShadowySpirits in #1880
• test(e2e): version upgrade test by @llzcx in #1822
• fix(s3stream/wal): fix memory leak by @Chillax-0v0 in #1896
• fix(e2e): fix data map format by @mooc9988 in #1898
• fix(metadata): fix sparse index leak on compaction split by @SCNieh in #1894
• fix(metadata): fix evict sparse index cache potential endless loop by @SCNieh in #1900
• feat(metadata): add metrics for sparse index cache monitor by @SCNieh in #1902
• fix(metadata): prevent concurrent uploading of local sparse index cache by @SCNieh in #1904
• fix(metadata): fix wrong stream number in serialization by @SCNieh in #1906
• feat(s3stream): add docs for checksumAlgorithm configuration by @ShadowySpirits in #1908
• fix(metadata): fix interrupted batch upload by @SCNieh in #1913
• perf(config): increase the default index interval from 4KiB to 1MiB by @Chillax-0v0 in #1915
• chore: add nightly release for automq by @daniel-y in #1916
• chore: polish the nightly release by @daniel-y in #1917
• chore: make the nightly release as a pre release by @daniel-y in #1918
• feat(s3stream): unify object not exist exception by @superhx in #1920
• fix(e2e): fix bug by @llzcx in #1922
• feat(s3stream): limit the inflight fast retry request count by @ShadowySpirits in #1919
• feat(eventLoop): the visibility of the shutdown flag for the event loop and optimizations for graceful shutdown by @CLFutureX in #1796
• chore(test): set runner to e2e by @superhx in #1929
• chore(telemetry): set the endpoint of otlp receiver manually by @Chillax-0v0 in #1927
• feat(metadata): expire node sparse index cache after write by @SCNieh in #1925
• feat(auto_balancer): limit the max number of nodes to reassign partit… by @SCNieh in #1933
• feat(metadata): blocking wait for uploading local index cache on stre… by @SCNieh in #1931
• feat(readme): add github trending logo by @vintagewang in #1936
• feat(s3stream): add checksum for s3 wal by @ShadowySpirits in #1939
• feat(s3stream): ensure compaction could be executed (#1935) by @superhx in #1937
• docs(s3stream/version): statement of features supported by S3Stream V1 by @Chillax-0v0 in #1943
• fix(s3stream): resolve unintended buffer reuse by @ShadowySpirits in #1945
• feat(s3stream): make s3client configuration can be override by @warr99 in #1947
• fix(s3stream): fix buffer leak by @ShadowySpirits in #1948
• fix(bufAlloc): adjust the default size by @CLFutureX in #1955
• perf(core): disable DeleteProduce tryComplete trace log by @lifepuzzlefun in #1951
• fix(s3stream): change reject handler to prevent task lost by @SCNieh in #1956
• feat(s3stream): change append callback thread number by @lifepuzzlefun in #1950
• feat(s3stream): support limit write bandwidth for WALBlockDeviceChannel by @lifepuzzlefun in #1941
• feat(readme): update aws marketplace url(#1936) by @vintagewang in #1958
• fix(issues1960): allow UNSET attributes for version 1.1 by @superhx in #1962
• build(dependencies): update Jackson to 2.17.1 by @warr99 in #1963
• feat(s3stream): add tail read throttle strategy by @SCNieh in #1965
• feat(wal): unOverCapacityException will lead to memory leaks by @CLFutureX in #1952
• perf(core): optimize FetchSession.update high memory allocate rate by @lifepuzzlefun in #1966
• perf(s3stream): optimize ByteBufAlloc.USAGE_STATS high cpu usage by @lifepuzzlefun in #1959
• fix(s3stream/wal): record metrics on WAL full by @Chillax-0v0 in #1968
• feat(s3stream): optimize recovery read throttle priority by @SCNieh in #1967
• Update README.md with new videos by @KaimingWan in #1969
• fix(log): use the same view to calculate trim offsets by @Chillax-0v0 in https://github.com...