1.2.0-beta0

What's Changed

• docs(metrics): refine telemetry README and remove unused components by @SCNieh in #1333
• fix(issues1334): fix stream reader endless looping by @superhx in #1335
• fix(perf): increase request timeout of the admin client by @Chillax-0v0 in #1336
• feat(core): forward stream apis by @ShadowySpirits in #1338
• chore: set code owners for the whole repo by @Chillax-0v0 in #1340
• feat(core): add command config by @ShadowySpirits in #1342
• fix(auto_balancer): fix broker status change by @SCNieh in #1339
• feat(metadata): add missing tags for the old stream by @superhx in #1346
• fix(s3stream): refine network rate limiter for better precision by @SCNieh in #1344
• fix(s3stream): fix variable typo by @yx9o in #1351
• docs(telemetry): simplify grafana dashboard templates by @SCNieh in #1354
• feat(shell): remove automq cli by @ShadowySpirits in #1355
• feat(core): log the block operation in controller event loop by @ShadowySpirits in #1352
• fix(s3stream): temporarily disable percentile metrics for performance issue by @SCNieh in #1353
• perf(s3stream/allocator): increase trunk size of the netty allocator by @Chillax-0v0 in #1364
• fix(issues1357): fix missing deletes when load from snapshot by @superhx in #1358
• chore(log): fix log by @superhx in #1365
• fix(s3stream): fix mismatched placeholders by @yx9o in #1369
• feat(shell): add basic command for automq cli by @ShadowySpirits in #1370
• fix(issues1367): stream reader prevent adding invalid blocks by @superhx in #1372
• chore(s3stream): add toString methods to fix logs by @Chillax-0v0 in #1381
• fix(cache): fix readhead fail when user read fast than readahead by @superhx in #1382
• fix(core): add tolerance delay when append with non-zero seq number with empty producer snapshot (#1377) by @SCNieh in #1384
• refactor(s3stream): remove DefaultS3Client's dependency on KafkaConfig by @Chillax-0v0 in #1388
• fix(issues604): fix response size not match by @superhx in #1392
• feat(tools/perf): adjust send rate during warmup and catchup by @Chillax-0v0 in #1395
• feat(s3stream): add new object storage abstract by @superhx in #1396
• fix(action): fix release action (#1398) by @superhx in #1399
• feat(core): optimize the block operation log in controller event loop by @ShadowySpirits in #1403
• fix(auto_balancer): remove unnecessary map copy by @SCNieh in #1404
• feat(core): make controller builder extensible by @SCNieh in #1406
• perf(s3stream): reduce lock granularity in StreamMetadataManager by @lifepuzzlefun in #1411
• fix(TimeIndex): wait for the last append to finish before fetching the stream by @Chillax-0v0 in #1407
• feat(auto_balancer): opt cluster model interface by @SCNieh in #1414
• chore(EventQueue): increase EVENT_PROCESS_TIME_THRESHOLD_MICROSECOND to 5ms by @Chillax-0v0 in #1412
• fix(cache): fix cache reuse for re-created topic by @superhx in #1417
• perf(metadata): use Timeline for objects image by @superhx in #1419
• feat(s3stream): add aws s3 rangeRead implementation for object storage by @warr99 in #1416
• fix(metadata): fix metadata access outdated image by @superhx in #1420
• fix(core): fix unexpected truncation of file cache by @ShadowySpirits in #1421
• feat(core): report s3 object number only on active controller by @SCNieh in #1424
• perf(FileCache): avoid evicting too many blocks at once by @Chillax-0v0 in #1425
• feat: merge from apache kafka 3.8 0971924 by @superhx in #1427
• fix(docs): fix contributing guide by @jitokim in #1428
• chore(examples): remove hardcoded value in TransactionProducer by @jitokim in #1426
• fix(config): fix default config for auto balancer listener name by @SCNieh in #1429
• fix(tools/perf): discard invalid latency values by @Chillax-0v0 in #1430
• test(s3stream): add objectStorage rangeRead test by @warr99 in #1423
• feat(s3stream): add aws s3 write implementation for object storage by @warr99 in #1434
• fix(auto_balancer): fix metrics compatibility for version V0 by @SCNieh in #1433
• fix(auto_balancer): match all endpoints when listener name is not spe… by @SCNieh in #1435
• feat(s3stream): composite object reader&writer by @superhx in #1432
• feat(s3stream): add s3 multipart implementation for object storage by @warr99 in #1438
• feat(s3stream): composite object add object attributes by @superhx in #1437
• fix(s3stream/wal): check the block size before start by @Chillax-0v0 in #1439
• feat(tools): fix StorageTool by @ShadowySpirits in #1442
• feat(s3stream): compact to composite object by @superhx in #1443
• feat(s3stream): add composite object deletion by @superhx in #1444
• feat(s3stream): add s3 delete implementation for object storage by @warr99 in #1441
• perf(s3stream): Avoid non-reuse TimerUtil object creation on write path by @lifepuzzlefun in #1447
• feat(s3stream): object storage writer by @warr99 in #1445
• feat(s3stream): add stream object compaction v1 trigger by @superhx in #1448
• feat(issue1134): prevent trivial scheduling by @SCNieh in #1449
• feat(auto_balancer): move internal topic partition only when necessary by @SCNieh in #1450
• feat(s3stream): adapt to new object storage abstraction by @superhx in #1451
• feat(core): implement broker and cluster level quota by @ShadowySpirits in #1440
• fix: stream e2e by @superhx in #1453
• feat: add composite object test by @superhx in #1454
• feat(s3stream): integrate composite object by @superhx in #1456
• fix(test): fix e2e by @superhx in #1457
• test(s3stream): add test case to verify end-of-object read behavior by @warr99 in #1455
• feat(auto_balancer): refactor cluster load snapshot for better extens… by @SCNieh in #1459
• chore: update README.md by @wensongz in #1460
• refactor(license): organize license files together by @KaimingWan in #1458
• chore: add a readme doc for s3stream by @daniel-y in #1461
• feat(issue1462): Optimize the Readme. #1462 by @vintagewang in #1463
• feat(s3stream): implement a prototype for the S3 Write-Ahead Log by @ShadowySpirits in #1465
• feat(s3stream): remove dependency on stream range offset by @SCNieh in #1466
• feat(metadata): optimize streamsetobject to support huge cluster by @superhx in #1464
• fix(test): fix connect e2e task timeout by @superhx in #1467
• fix(test): skip unsupported test by @superhx in #1468
• fix(s3stream): ensure wal header shutdown type UNGRACEFULLY when startup by @lifepuzzlefun in #1469
• chore(all): adapt to java21 by @superhx in #1471
• feat(s3stream): implement AcknowledgmentService by @ShadowySpirits in #1470
• feat(core): add extension point for TelemetryManager by @SCNieh in #1472
• fix(auto_balancer): fix broker status by @SCNieh in #1480
• fix(auto_balancer): remove partition from cluster model when it has n… by @SCNieh in #1484
• fix(auto_balancer): fix npe when remove partition from cluster by @SCNieh in #1486
• fix(api): fix channel isn't switch when encounter NOT_CONTROLLER by @superhx in #1489
• fix(s3shell): fix object cleanup by @ShadowySpirits in #1491
• fix(s3stream): Fix IO CompletableFuture not complete forever when goto retry logic by @lifepuzzlefun in #1487
• build(aws): upgrade aws sdk version to 2.26.10 by @SCNieh in #1494
• build(netty): upgrade netty version to 4.1.111 by @SCNieh in #1495
• refactor(s3stream): refactor object storage by @superhx in #1498
• fix(s3stream): fix lock protect when update liveEpoch in S3ObjectsImage by @lifepuzzlefun in #1493
• build(gradle): enable Gradle wrapper validation by @sullis in #1496
• feat(auto_balancer): log broker load change after each optimization by @SCNieh in #1497
• fix(metadata): prevent duplicate release for constant instance by @SCNieh in #1500
• refactor(config): extract automq config by @superhx in #1501
• fix(s3stream): fix s3 readiness check by @superhx in #1502
• fix(s3stream): use segment-unique id as file cache key by @SCNieh in #1504
• fix(s3stream): avoid compaction shortly after opening a stream by @Chillax-0v0 in #1505
• perf(s3stream): use FastThreadLocal in WAL io executor by @lifepuzzlefun in #1507
• feat(config): new bucket URI config by @superhx in #1506
• fix(metadata): fix object attributes lost after snapshot by @superhx in #1508
• chore(test): check object attributes after snapshot by @superhx in #1509
• feat(s3stream): optimize get objects performance by @SCNieh in #1512
• perf(s3stream): batch delete object when compact Composite object by @lifepuzzlefun in #1513
• feat(s3stream): adapt to bucket id by @superhx in #1514
• fix(s3stream): fix delete composite object exceed S3 API limit by @lifepuzzlefun in #1518
• fix: Fix typos by @szepeviktor in #1516
• chore: Introduce EditorConfig by @szepeviktor in #1511
• fix(s3stream): fix streamsetobject force split fail by @lifepuzzlefun in #1521
• fix(tool): fix generate s3 url tool region by @lifepuzzlefun in #1522
• fix(s3stream): optimize retry policy on s3 request exception by @SCNieh in #1524
• fix(issues1527): fix delete empty list by @superhx in #1528
• fix(issue1526): avoid completing future before search complete by @SCNieh in #1531
• fix(s3stream): avoid MAJOR_V1 compact composite object itself by @lifepuzzlefun in #1535
• feat(s3stream): implement object storage wal by @ShadowySpirits in #1538
• feat(config): decrease autobalancer default avg deviation ratio to 0.1 by @SCNieh in #1543
• fix(config): fix gcp bucket parsing issue by @warr99 in #1537
• fix(s3stream): composite object use retained size by @superhx in #1532
• fix(s3stream): shutdown all executor in close method by @warr99 in #1529
• feat(e2e): kafka.py in addition to JVM parameters, additional environment variables added at startup. by @llzcx in #1536
• fix(issues1539): fix auto-kafka-admin.sh help information. by @mapan1984 in #1541
• feat(s3stream): refactor configuration s3.wal.path by @ShadowySpirits in #1545
• feat(s3stream): Implement read-ahead functionality during object WAL recovery by @ShadowySpirits in #1548
• fix(issue 1547): Add asynchronous callbacks to tryReadahead in afterRead. by @llzcx in #1553
• feat(ci): update github-release.yml by @ShadowySpirits in #1555

New Contributors

• @yx9o made their first contribution in #1351
• @jitokim made their first contribution in #1428
• @wensongz made their first contribution in #1460
• @vintagewang made their first contribution in #1463
• @sullis made their first contribution in #1496
• @szepeviktor made their first contribution in #1516
• @llzcx made their first contribution in #1536
• @mapan1984 made their first contribution in #1541

Full Changelog: 1.1.1-rc0...1.2.0-beta0