Bump Groovy: 3.0.24 -> 4.0.26 #9745

AlexeyKuznetsov-DD · 2025-10-13T18:42:18Z

DO NOT MERGE

What Does This Do

Bump Groovy: 3.0.24 -> 4.0.26

Motivation

Latest Groovy

Additional Notes

pr-commenter · 2025-10-13T19:24:55Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1763974460	1764025361
git_commit_sha	`c79dfc6`	`6c13302`
release_version	1.57.0-SNAPSHOT~c79dfc656d	1.55.0-SNAPSHOT~6c1330275f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1764027317	1764027317
ci_job_id	1254872960	1254872960
ci_pipeline_id	83881454	83881454
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-jcdtdssn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-jcdtdssn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~6c1330275f, baseline=1.57.0-SNAPSHOT~c79dfc656d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.107 s) : 0, 1107181
Total [baseline] (10.849 s) : 0, 10849096
Agent [candidate] (1.106 s) : 0, 1105999
Total [candidate] (10.975 s) : 0, 10975139
section appsec
Agent [baseline] (1.291 s) : 0, 1291286
Total [baseline] (11.257 s) : 0, 11257035
Agent [candidate] (1.286 s) : 0, 1285715
Total [candidate] (11.323 s) : 0, 11323117
section iast
Agent [baseline] (1.239 s) : 0, 1239307
Total [baseline] (11.3 s) : 0, 11300294
Agent [candidate] (1.24 s) : 0, 1240497
Total [candidate] (11.284 s) : 0, 11283754
section profiling
Agent [baseline] (1.256 s) : 0, 1255740
Total [baseline] (11.246 s) : 0, 11245800
Agent [candidate] (1.241 s) : 0, 1241459
Total [candidate] (11.329 s) : 0, 11328570

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.107 s	-
Agent	appsec	1.291 s	184.104 ms (16.6%)
Agent	iast	1.239 s	132.125 ms (11.9%)
Agent	profiling	1.256 s	148.559 ms (13.4%)
Total	tracing	10.849 s	-
Total	appsec	11.257 s	407.939 ms (3.8%)
Total	iast	11.3 s	451.198 ms (4.2%)
Total	profiling	11.246 s	396.704 ms (3.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.106 s	-
Agent	appsec	1.286 s	179.716 ms (16.2%)
Agent	iast	1.24 s	134.498 ms (12.2%)
Agent	profiling	1.241 s	135.46 ms (12.2%)
Total	tracing	10.975 s	-
Total	appsec	11.323 s	347.979 ms (3.2%)
Total	iast	11.284 s	308.615 ms (2.8%)
Total	profiling	11.329 s	353.431 ms (3.2%)

gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~6c1330275f, baseline=1.57.0-SNAPSHOT~c79dfc656d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.508 ms) : 0, 1508
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (712.528 ms) : 0, 712528
BytebuddyAgent [candidate] (709.848 ms) : 0, 709848
GlobalTracer [baseline] (249.63 ms) : 0, 249630
GlobalTracer [candidate] (250.662 ms) : 0, 250662
AppSec [baseline] (31.941 ms) : 0, 31941
AppSec [candidate] (32.262 ms) : 0, 32262
Debugger [baseline] (64.091 ms) : 0, 64091
Debugger [candidate] (64.32 ms) : 0, 64320
Remote Config [baseline] (634.227 µs) : 0, 634
Remote Config [candidate] (627.892 µs) : 0, 628
Telemetry [baseline] (8.235 ms) : 0, 8235
Telemetry [candidate] (8.306 ms) : 0, 8306
Flare Poller [baseline] (3.696 ms) : 0, 3696
Flare Poller [candidate] (3.74 ms) : 0, 3740
section appsec
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (736.578 ms) : 0, 736578
BytebuddyAgent [candidate] (732.808 ms) : 0, 732808
GlobalTracer [baseline] (242.437 ms) : 0, 242437
GlobalTracer [candidate] (241.104 ms) : 0, 241104
AppSec [baseline] (175.395 ms) : 0, 175395
AppSec [candidate] (175.145 ms) : 0, 175145
Debugger [baseline] (62.301 ms) : 0, 62301
Debugger [candidate] (62.116 ms) : 0, 62116
Remote Config [baseline] (675.324 µs) : 0, 675
Remote Config [candidate] (673.927 µs) : 0, 674
Telemetry [baseline] (8.49 ms) : 0, 8490
Telemetry [candidate] (8.387 ms) : 0, 8387
Flare Poller [baseline] (3.996 ms) : 0, 3996
Flare Poller [candidate] (3.957 ms) : 0, 3957
IAST [baseline] (24.933 ms) : 0, 24933
IAST [candidate] (25.213 ms) : 0, 25213
section iast
crashtracking [baseline] (1.482 ms) : 0, 1482
crashtracking [candidate] (1.489 ms) : 0, 1489
BytebuddyAgent [baseline] (831.794 ms) : 0, 831794
BytebuddyAgent [candidate] (832.334 ms) : 0, 832334
GlobalTracer [baseline] (237.793 ms) : 0, 237793
GlobalTracer [candidate] (238.274 ms) : 0, 238274
AppSec [baseline] (34.68 ms) : 0, 34680
AppSec [candidate] (33.941 ms) : 0, 33941
Debugger [baseline] (60.587 ms) : 0, 60587
Debugger [candidate] (60.626 ms) : 0, 60626
Remote Config [baseline] (542.149 µs) : 0, 542
Remote Config [candidate] (532.646 µs) : 0, 533
Telemetry [baseline] (7.624 ms) : 0, 7624
Telemetry [candidate] (7.607 ms) : 0, 7607
Flare Poller [baseline] (3.508 ms) : 0, 3508
Flare Poller [candidate] (3.48 ms) : 0, 3480
IAST [baseline] (26.508 ms) : 0, 26508
IAST [candidate] (27.483 ms) : 0, 27483
section profiling
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.435 ms) : 0, 1435
BytebuddyAgent [baseline] (749.829 ms) : 0, 749829
BytebuddyAgent [candidate] (740.412 ms) : 0, 740412
GlobalTracer [baseline] (226.915 ms) : 0, 226915
GlobalTracer [candidate] (224.201 ms) : 0, 224201
AppSec [baseline] (33.818 ms) : 0, 33818
AppSec [candidate] (32.446 ms) : 0, 32446
Debugger [baseline] (63.372 ms) : 0, 63372
Debugger [candidate] (63.492 ms) : 0, 63492
Remote Config [baseline] (674.901 µs) : 0, 675
Remote Config [candidate] (662.702 µs) : 0, 663
Telemetry [baseline] (8.205 ms) : 0, 8205
Telemetry [candidate] (8.18 ms) : 0, 8180
Flare Poller [baseline] (3.887 ms) : 0, 3887
Flare Poller [candidate] (3.71 ms) : 0, 3710
ProfilingAgent [baseline] (97.321 ms) : 0, 97321
ProfilingAgent [candidate] (97.449 ms) : 0, 97449
Profiling [baseline] (97.904 ms) : 0, 97904
Profiling [candidate] (98.032 ms) : 0, 98032

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~6c1330275f, baseline=1.57.0-SNAPSHOT~c79dfc656d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.098 s) : 0, 1098005
Total [baseline] (8.847 s) : 0, 8847458
Agent [candidate] (1.102 s) : 0, 1101618
Total [candidate] (8.844 s) : 0, 8844387
section iast
Agent [baseline] (1.239 s) : 0, 1238902
Total [baseline] (9.551 s) : 0, 9550877
Agent [candidate] (1.239 s) : 0, 1238576
Total [candidate] (9.535 s) : 0, 9535186

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.098 s	-
Agent	iast	1.239 s	140.897 ms (12.8%)
Total	tracing	8.847 s	-
Total	iast	9.551 s	703.42 ms (8.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.102 s	-
Agent	iast	1.239 s	136.958 ms (12.4%)
Total	tracing	8.844 s	-
Total	iast	9.535 s	690.799 ms (7.8%)

gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~6c1330275f, baseline=1.57.0-SNAPSHOT~c79dfc656d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.482 ms) : 0, 1482
crashtracking [candidate] (1.481 ms) : 0, 1481
BytebuddyAgent [baseline] (706.079 ms) : 0, 706079
BytebuddyAgent [candidate] (708.738 ms) : 0, 708738
GlobalTracer [baseline] (248.335 ms) : 0, 248335
GlobalTracer [candidate] (249.142 ms) : 0, 249142
AppSec [baseline] (31.868 ms) : 0, 31868
AppSec [candidate] (31.983 ms) : 0, 31983
Debugger [baseline] (62.868 ms) : 0, 62868
Debugger [candidate] (62.908 ms) : 0, 62908
Remote Config [baseline] (624.285 µs) : 0, 624
Remote Config [candidate] (619.362 µs) : 0, 619
Telemetry [baseline] (8.305 ms) : 0, 8305
Telemetry [candidate] (8.231 ms) : 0, 8231
Flare Poller [baseline] (3.674 ms) : 0, 3674
Flare Poller [candidate] (3.695 ms) : 0, 3695
section iast
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.476 ms) : 0, 1476
BytebuddyAgent [baseline] (831.698 ms) : 0, 831698
BytebuddyAgent [candidate] (831.351 ms) : 0, 831351
GlobalTracer [baseline] (237.539 ms) : 0, 237539
GlobalTracer [candidate] (237.648 ms) : 0, 237648
AppSec [baseline] (33.477 ms) : 0, 33477
AppSec [candidate] (35.072 ms) : 0, 35072
Debugger [baseline] (59.856 ms) : 0, 59856
Debugger [candidate] (59.915 ms) : 0, 59915
Remote Config [baseline] (536.789 µs) : 0, 537
Remote Config [candidate] (537.912 µs) : 0, 538
Telemetry [baseline] (7.548 ms) : 0, 7548
Telemetry [candidate] (7.615 ms) : 0, 7615
Flare Poller [baseline] (3.441 ms) : 0, 3441
Flare Poller [candidate] (3.444 ms) : 0, 3444
IAST [baseline] (28.52 ms) : 0, 28520
IAST [candidate] (26.649 ms) : 0, 26649

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1763974460	1764025361
git_commit_sha	`c79dfc6`	`6c13302`
release_version	1.57.0-SNAPSHOT~c79dfc656d	1.55.0-SNAPSHOT~6c1330275f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1764027821	1764027821
ci_job_id	1254872961	1254872961
ci_pipeline_id	83881454	83881454
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-a01wlsf5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-a01wlsf5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+50.681µs; +176.004µs] or [+3.122%; +10.841%]	unstable [+111.997µs; +1070.913µs] or [+2.460%; +23.523%]	unstable [-487.300op/s; +60.175op/s] or [-21.244%; +2.623%]	1.737ms	5.144ms	2080.219op/s	1.623ms	4.553ms	2293.781op/s
scenario:load:insecure-bank:iast:high_load	better [-217.194µs; -80.671µs] or [-8.261%; -3.068%]	better [-596.553µs; -168.847µs] or [-7.879%; -2.230%]	unstable [-78.675op/s; +237.487op/s] or [-5.748%; +17.351%]	2.480ms	7.189ms	1448.156op/s	2.629ms	7.571ms	1368.750op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~6c1330275f, baseline=1.57.0-SNAPSHOT~c79dfc656d
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.142 ms) : 17954, 18331
.   : milestone, 18142,
appsec (18.726 ms) : 18537, 18915
.   : milestone, 18726,
code_origins (18.672 ms) : 18486, 18859
.   : milestone, 18672,
iast (18.423 ms) : 18239, 18608
.   : milestone, 18423,
profiling (18.93 ms) : 18741, 19120
.   : milestone, 18930,
tracing (17.923 ms) : 17744, 18101
.   : milestone, 17923,
section candidate
no_agent (18.072 ms) : 17892, 18251
.   : milestone, 18072,
appsec (18.699 ms) : 18510, 18888
.   : milestone, 18699,
code_origins (17.969 ms) : 17788, 18150
.   : milestone, 17969,
iast (18.108 ms) : 17930, 18286
.   : milestone, 18108,
profiling (18.863 ms) : 18670, 19056
.   : milestone, 18863,
tracing (17.914 ms) : 17735, 18092
.   : milestone, 17914,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.142 ms [17.954 ms, 18.331 ms]	-
appsec	18.726 ms [18.537 ms, 18.915 ms]	583.557 µs (3.2%)
code_origins	18.672 ms [18.486 ms, 18.859 ms]	530.205 µs (2.9%)
iast	18.423 ms [18.239 ms, 18.608 ms]	281.214 µs (1.6%)
profiling	18.93 ms [18.741 ms, 19.12 ms]	788.206 µs (4.3%)
tracing	17.923 ms [17.744 ms, 18.101 ms]	-219.68 µs (-1.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.072 ms [17.892 ms, 18.251 ms]	-
appsec	18.699 ms [18.51 ms, 18.888 ms]	627.368 µs (3.5%)
code_origins	17.969 ms [17.788 ms, 18.15 ms]	-102.266 µs (-0.6%)
iast	18.108 ms [17.93 ms, 18.286 ms]	36.414 µs (0.2%)
profiling	18.863 ms [18.67 ms, 19.056 ms]	791.179 µs (4.4%)
tracing	17.914 ms [17.735 ms, 18.092 ms]	-157.984 µs (-0.9%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~6c1330275f, baseline=1.57.0-SNAPSHOT~c79dfc656d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.224 ms) : 1211, 1237
.   : milestone, 1224,
iast (3.345 ms) : 3300, 3389
.   : milestone, 3345,
iast_FULL (5.814 ms) : 5756, 5872
.   : milestone, 5814,
iast_GLOBAL (3.694 ms) : 3625, 3763
.   : milestone, 3694,
profiling (1.966 ms) : 1949, 1984
.   : milestone, 1966,
tracing (1.831 ms) : 1816, 1847
.   : milestone, 1831,
section candidate
no_agent (1.208 ms) : 1196, 1220
.   : milestone, 1208,
iast (3.158 ms) : 3118, 3198
.   : milestone, 3158,
iast_FULL (5.715 ms) : 5657, 5772
.   : milestone, 5715,
iast_GLOBAL (3.687 ms) : 3624, 3750
.   : milestone, 3687,
profiling (2.176 ms) : 2155, 2196
.   : milestone, 2176,
tracing (1.833 ms) : 1818, 1848
.   : milestone, 1833,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.224 ms [1.211 ms, 1.237 ms]	-
iast	3.345 ms [3.3 ms, 3.389 ms]	2.121 ms (173.3%)
iast_FULL	5.814 ms [5.756 ms, 5.872 ms]	4.59 ms (375.0%)
iast_GLOBAL	3.694 ms [3.625 ms, 3.763 ms]	2.47 ms (201.8%)
profiling	1.966 ms [1.949 ms, 1.984 ms]	742.027 µs (60.6%)
tracing	1.831 ms [1.816 ms, 1.847 ms]	607.388 µs (49.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.208 ms [1.196 ms, 1.22 ms]	-
iast	3.158 ms [3.118 ms, 3.198 ms]	1.95 ms (161.4%)
iast_FULL	5.715 ms [5.657 ms, 5.772 ms]	4.506 ms (373.0%)
iast_GLOBAL	3.687 ms [3.624 ms, 3.75 ms]	2.479 ms (205.2%)
profiling	2.176 ms [2.155 ms, 2.196 ms]	967.356 µs (80.1%)
tracing	1.833 ms [1.818 ms, 1.848 ms]	624.423 µs (51.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1763974460	1764025361
git_commit_sha	`c79dfc6`	`6c13302`
release_version	1.57.0-SNAPSHOT~c79dfc656d	1.55.0-SNAPSHOT~6c1330275f

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1764027494	1764027494
ci_job_id	1254872962	1254872962
ci_pipeline_id	83881454	83881454
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-lhmv0va6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-lhmv0va6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~6c1330275f, baseline=1.57.0-SNAPSHOT~c79dfc656d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (2.536 ms) : 2481, 2591
.   : milestone, 2536,
iast (2.228 ms) : 2163, 2293
.   : milestone, 2228,
iast_GLOBAL (2.273 ms) : 2208, 2338
.   : milestone, 2273,
profiling (2.103 ms) : 2048, 2157
.   : milestone, 2103,
tracing (2.066 ms) : 2015, 2118
.   : milestone, 2066,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.72 ms) : 3501, 3940
.   : milestone, 3720,
iast (2.231 ms) : 2166, 2296
.   : milestone, 2231,
iast_GLOBAL (2.269 ms) : 2204, 2335
.   : milestone, 2269,
profiling (2.082 ms) : 2029, 2135
.   : milestone, 2082,
tracing (2.053 ms) : 2002, 2104
.   : milestone, 2053,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	2.536 ms [2.481 ms, 2.591 ms]	1.057 ms (71.5%)
iast	2.228 ms [2.163 ms, 2.293 ms]	748.878 µs (50.6%)
iast_GLOBAL	2.273 ms [2.208 ms, 2.338 ms]	794.237 µs (53.7%)
profiling	2.103 ms [2.048 ms, 2.157 ms]	623.597 µs (42.2%)
tracing	2.066 ms [2.015 ms, 2.118 ms]	587.26 µs (39.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.468 ms, 1.491 ms]	-
appsec	3.72 ms [3.501 ms, 3.94 ms]	2.241 ms (151.5%)
iast	2.231 ms [2.166 ms, 2.296 ms]	751.476 µs (50.8%)
iast_GLOBAL	2.269 ms [2.204 ms, 2.335 ms]	789.841 µs (53.4%)
profiling	2.082 ms [2.029 ms, 2.135 ms]	602.513 µs (40.7%)
tracing	2.053 ms [2.002 ms, 2.104 ms]	573.518 µs (38.8%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~6c1330275f, baseline=1.57.0-SNAPSHOT~c79dfc656d
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.813 s) : 14813000, 14813000
.   : milestone, 14813000,
appsec (14.781 s) : 14781000, 14781000
.   : milestone, 14781000,
iast (18.761 s) : 18761000, 18761000
.   : milestone, 18761000,
iast_GLOBAL (18.088 s) : 18088000, 18088000
.   : milestone, 18088000,
profiling (15.55 s) : 15550000, 15550000
.   : milestone, 15550000,
tracing (14.983 s) : 14983000, 14983000
.   : milestone, 14983000,
section candidate
no_agent (15.538 s) : 15538000, 15538000
.   : milestone, 15538000,
appsec (14.935 s) : 14935000, 14935000
.   : milestone, 14935000,
iast (18.685 s) : 18685000, 18685000
.   : milestone, 18685000,
iast_GLOBAL (18.262 s) : 18262000, 18262000
.   : milestone, 18262000,
profiling (15.248 s) : 15248000, 15248000
.   : milestone, 15248000,
tracing (14.698 s) : 14698000, 14698000
.   : milestone, 14698000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.813 s [14.813 s, 14.813 s]	-
appsec	14.781 s [14.781 s, 14.781 s]	-32.0 ms (-0.2%)
iast	18.761 s [18.761 s, 18.761 s]	3.948 s (26.7%)
iast_GLOBAL	18.088 s [18.088 s, 18.088 s]	3.275 s (22.1%)
profiling	15.55 s [15.55 s, 15.55 s]	737.0 ms (5.0%)
tracing	14.983 s [14.983 s, 14.983 s]	170.0 ms (1.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.538 s [15.538 s, 15.538 s]	-
appsec	14.935 s [14.935 s, 14.935 s]	-603.0 ms (-3.9%)
iast	18.685 s [18.685 s, 18.685 s]	3.147 s (20.3%)
iast_GLOBAL	18.262 s [18.262 s, 18.262 s]	2.724 s (17.5%)
profiling	15.248 s [15.248 s, 15.248 s]	-290.0 ms (-1.9%)
tracing	14.698 s [14.698 s, 14.698 s]	-840.0 ms (-5.4%)

# Conflicts: # dd-smoke-tests/src/main/groovy/datadog/smoketest/ProcessManager.groovy

pr-commenter · 2025-10-25T03:32:28Z

Kafka / producer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1763974460	1764025361
git_commit_sha	`c79dfc6`	`6c13302`

See matching parameters

	Baseline	Candidate
ci_job_date	1764026517	1764026517
ci_job_id	1254872965	1254872965
ci_pipeline_id	83881454	83881454
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce	unsure [+3039.897op/s; +89339.399op/s] or [+0.173%; +5.080%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce	same

pr-commenter · 2025-10-25T03:45:37Z

Kafka / consumer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1763974460	1764025361
git_commit_sha	`c79dfc6`	`6c13302`

See matching parameters

	Baseline	Candidate
ci_job_date	1764026555	1764026555
ci_job_id	1254872966	1254872966
ci_pipeline_id	83881454	83881454
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same

…pringboot-openliberty-20` - it is failing on CI.

# Conflicts: # gradle/libs.versions.toml

# Conflicts: # buildSrc/call-site-instrumentation-plugin/build.gradle.kts # dd-java-agent/instrumentation/kafka/kafka-clients-0.11/build.gradle # telemetry/src/test/groovy/datadog/telemetry/dependency/DependencyResolverSpecification.groovy

# Conflicts: # .gitlab-ci.yml # dd-java-agent/instrumentation/servlet/javax-servlet/javax-servlet-3.0/src/test/groovy/JettyServlet3Test.groovy

# Conflicts: # dd-java-agent/instrumentation/servlet/javax-servlet/javax-servlet-2.2/src/test/groovy/TestServlet2.groovy # dd-java-agent/instrumentation/servlet/javax-servlet/javax-servlet-3.0/src/test/groovy/JettyServlet3Test.groovy # dd-java-agent/instrumentation/servlet/javax-servlet/javax-servlet-common/src/test/groovy/HttpServletTest.groovy

# Conflicts: # dd-java-agent/instrumentation/spring/spring-cloud-zuul-2.0/build.gradle # dd-java-agent/instrumentation/spring/spring-data-1.8/build.gradle # dd-java-agent/instrumentation/spring/spring-webmvc/spring-webmvc-3.1/build.gradle # dd-java-agent/instrumentation/spring/spring-webmvc/spring-webmvc-5.3/build.gradle # dd-java-agent/instrumentation/spring/spring-webmvc/spring-webmvc-6.0/build.gradle

# Conflicts: # dd-trace-core/src/main/java/datadog/trace/core/CoreTracer.java

Bump Groovy: 3.0.24 -> 4.0.28

3866a54

AlexeyKuznetsov-DD self-assigned this Oct 13, 2025

AlexeyKuznetsov-DD added tag: do not merge Do not merge changes comp: tooling Build & Tooling labels Oct 13, 2025

WIP

f128d3c

AlexeyKuznetsov-DD added 11 commits October 13, 2025 16:38

WIP 2

9dffccd

WIP 3

d88be22

WIP 4

51da522

Merge branch 'master' into alexeyk/groovy-4

fb2f81e

Merge branch 'master' into alexeyk/groovy-4

af5d06d

Merge branch 'master' into alexeyk/groovy-4

765fd92

Spotbugs tweaks.

1ca9595

Merge branch 'master' into alexeyk/groovy-4

226a2c5

WIP tweaks

a429354

Merge branch 'master' into alexeyk/groovy-4

ad15665

# Conflicts: # dd-smoke-tests/src/main/groovy/datadog/smoketest/ProcessManager.groovy

Fixed Groovy ambiguity. Tweaked

8fdf26b

AlexeyKuznetsov-DD added 5 commits October 24, 2025 23:52

Build workaround.

e687aa9

Fixed Groovy compiler settings.

6da67dd

Fixed Groovy compiler settings.

69ccd4a

Fixed Groovy compiler settings.

7c04a1c

Refactored Groovy compiler config. Disabled module `:dd-smoke-tests:s…

5b73524

…pringboot-openliberty-20` - it is failing on CI.

This comment has been minimized.

Sign in to view

AlexeyKuznetsov-DD added 5 commits October 25, 2025 19:30

Tests fixed.

7a0bd21

Revert some code. Ignore tests.

e863a91

Fixed tests. Ignore tests.

76dcdd8

Ignore tests.

ca64f39

Ignore tests

27c46bc

AlexeyKuznetsov-DD added 25 commits November 6, 2025 15:25

Fixed build.

d3d8f43

Fixed build.

be3215f

Fixed tests.

7ebb3db

Merge branch 'master' into alexeyk/groovy-4

d03fee4

# Conflicts: # gradle/libs.versions.toml

Fixed tests.

bf02b3f

Fixed tests.

9a038e9

JUnit works only with Groovy 4.0.26 (Same as Spock)

7b7df33

Merge branch 'master' into alexeyk/groovy-4

e9128d5

Merged with master

f3152e3

Fixed :dd-smoke-tests:gradle module tests.

df4602c

Merge branch 'master' into alexeyk/groovy-4

aa5bcbf

Merge branch 'master' into alexeyk/groovy-4

9352e18

# Conflicts: # buildSrc/call-site-instrumentation-plugin/build.gradle.kts # dd-java-agent/instrumentation/kafka/kafka-clients-0.11/build.gradle # telemetry/src/test/groovy/datadog/telemetry/dependency/DependencyResolverSpecification.groovy

Merge branch 'master' into alexeyk/groovy-4

aa1c447

# Conflicts: # .gitlab-ci.yml # dd-java-agent/instrumentation/servlet/javax-servlet/javax-servlet-3.0/src/test/groovy/JettyServlet3Test.groovy

Merge branch 'master' into alexeyk/groovy-4

c05bf3c

Merge branch 'master' into alexeyk/groovy-4

0c6a9a4

Refactored groovy and spock configuration to plugin.

4fedc8f

Merge branch 'master' into alexeyk/groovy-4

7d882b5

Merge branch 'master' into alexeyk/groovy-4

a9856a1

Added missing objenesis

17998ec

Fixed tests and refactored configurations.

6a4b28a

All spock dependencies should be in groovySpock config.

6d030ce

Minor fix

314ba85

Merge branch 'master' into alexeyk/groovy-4

5af7b01

AlexeyKuznetsov-DD changed the title ~~Bump Groovy: 3.0.24 -> 4.0.28~~ Bump Groovy: 3.0.24 -> 4.0.26 Nov 21, 2025

AlexeyKuznetsov-DD added 4 commits November 21, 2025 13:59

Cleanup.

a647df7

Merge branch 'master' into alexeyk/groovy-4

7ff5d91

# Conflicts: # dd-trace-core/src/main/java/datadog/trace/core/CoreTracer.java

Bump Groovy and Spock versions.

c692c4b

Reverted version of Groovy and Spock, to prev version.

6c13302

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Bump Groovy: 3.0.24 -> 4.0.26 #9745

Bump Groovy: 3.0.24 -> 4.0.26 #9745

Uh oh!

AlexeyKuznetsov-DD commented Oct 13, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Oct 13, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Oct 25, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Oct 25, 2025 •

edited

Loading

Uh oh!

This comment has been minimized.

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Bump Groovy: 3.0.24 -> 4.0.26 #9745

Are you sure you want to change the base?

Bump Groovy: 3.0.24 -> 4.0.26 #9745

Uh oh!

Conversation

AlexeyKuznetsov-DD commented Oct 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Uh oh!

pr-commenter bot commented Oct 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

pr-commenter bot commented Oct 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Kafka / producer-benchmark

Parameters

Summary

Uh oh!

pr-commenter bot commented Oct 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Kafka / consumer-benchmark

Parameters

Summary

Uh oh!

This comment has been minimized.

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

AlexeyKuznetsov-DD commented Oct 13, 2025 •

edited

Loading

pr-commenter bot commented Oct 13, 2025 •

edited

Loading

pr-commenter bot commented Oct 25, 2025 •

edited

Loading

pr-commenter bot commented Oct 25, 2025 •

edited

Loading