Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

upgrade(tracer): Use libdatadog for Stable Config implementation #8436

Draft
wants to merge 4 commits into
base: mtoff/stable_config
Choose a base branch
from
Draft

upgrade(tracer): Use libdatadog for Stable Config implementation #8436

wants to merge 4 commits into from

Conversation

BaptisteFoy
Copy link
Contributor

@BaptisteFoy BaptisteFoy commented Feb 22, 2025 •
edited
Loading

What Does This Do

  • Create a small Rust program to use libdatadog to fetch stable config
  • Add build jobs of the native lib in the CI
  • Embed the native libs in the jar
  • Fetch the native libs from the jar & extract it in a temp dir
  • Use the extracted lib through JNI

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@BaptisteFoy BaptisteFoy force-pushed the paullgdc/stable_config/common_component branch from 605afec to a938c8e Compare February 22, 2025 12:20
@pr-commenter
Copy link

pr-commenter bot commented Feb 22, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master paullgdc/stable_config/common_component
git_commit_date 1740159057 1740226798
git_commit_sha 19ce7f1 a938c8e
release_version 1.47.0-SNAPSHOT~19ce7f1a2a 1.47.0-SNAPSHOT~a938c8e65e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740229271 1740229271
ci_job_id 818981372 818981372
ci_pipeline_id 56667511 56667511
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-6g4kekrx-project-304-concurrent-0-dqj0r0p3 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-6g4kekrx-project-304-concurrent-0-dqj0r0p3 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 7 performance improvements and 4 performance regressions! Performance is the same for 45 metrics, 7 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:AppSec better
[-9.488ms; -8.439ms] or [-16.531%; -14.704%]		 48.430ms 57.393ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:AppSec better
[-8.994ms; -7.815ms] or [-15.711%; -13.652%]		 48.842ms 57.247ms
scenario:startup:insecure-bank:tracing:AppSec worse
[+4.135ms; +7.266ms] or [+7.462%; +13.112%]		 61.112ms 55.412ms
scenario:startup:insecure-bank:tracing:Remote Config better
[-46.314µs; -19.045µs] or [-6.719%; -2.763%]		 656.654µs 689.333µs
scenario:startup:petclinic:appsec:Agent.start better
[-39.812ms; -24.276ms] or [-3.372%; -2.056%]		 1.149s 1.181s
scenario:startup:petclinic:appsec:AppSec better
[-29.114ms; -27.475ms] or [-16.468%; -15.541%]		 148.495ms 176.789ms
scenario:startup:petclinic:iast:AppSec better
[-9.054ms; -7.428ms] or [-15.781%; -12.946%]		 49.135ms 57.377ms
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+3.577ms; +6.168ms] or [+3.732%; +6.434%]		 100.733ms 95.860ms
scenario:startup:petclinic:profiling:GlobalTracer better
[-23.426ms; -20.805ms] or [-6.685%; -5.937%]		 328.292ms 350.407ms
scenario:startup:petclinic:profiling:Profiling worse
[+3.579ms; +6.170ms] or [+3.732%; +6.435%]		 100.761ms 95.887ms
scenario:startup:petclinic:tracing:AppSec worse
[+5.702ms; +7.135ms] or [+10.291%; +12.879%]		 61.822ms 55.404ms
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~a938c8e65e, baseline=1.47.0-SNAPSHOT~19ce7f1a2a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1039693
Total [baseline] (10.432 s) : 0, 10431575
Agent [candidate] (1.047 s) : 0, 1046611
Total [candidate] (10.413 s) : 0, 10413002
section appsec
Agent [baseline] (1.181 s) : 0, 1180683
Total [baseline] (10.759 s) : 0, 10758892
Agent [candidate] (1.149 s) : 0, 1148639
Total [candidate] (10.723 s) : 0, 10723382
section iast
Agent [baseline] (1.174 s) : 0, 1174038
Total [baseline] (10.999 s) : 0, 10998734
Agent [candidate] (1.17 s) : 0, 1170309
Total [candidate] (10.954 s) : 0, 10954156
section profiling
Agent [baseline] (1.262 s) : 0, 1262351
Total [baseline] (10.85 s) : 0, 10849843
Agent [candidate] (1.242 s) : 0, 1242059
Total [candidate] (10.791 s) : 0, 10791088
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.181 s 140.991 ms (13.6%)
Agent iast 1.174 s 134.345 ms (12.9%)
Agent profiling 1.262 s 222.659 ms (21.4%)
Total tracing 10.432 s -
Total appsec 10.759 s 327.317 ms (3.1%)
Total iast 10.999 s 567.16 ms (5.4%)
Total profiling 10.85 s 418.268 ms (4.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.149 s 102.029 ms (9.7%)
Agent iast 1.17 s 123.699 ms (11.8%)
Agent profiling 1.242 s 195.448 ms (18.7%)
Total tracing 10.413 s -
Total appsec 10.723 s 310.38 ms (3.0%)
Total iast 10.954 s 541.154 ms (5.2%)
Total profiling 10.791 s 378.086 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~a938c8e65e, baseline=1.47.0-SNAPSHOT~19ce7f1a2a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.723 ms) : 0, 716723
BytebuddyAgent [candidate] (722.659 ms) : 0, 722659
GlobalTracer [baseline] (239.411 ms) : 0, 239411
GlobalTracer [candidate] (237.403 ms) : 0, 237403
AppSec [baseline] (55.404 ms) : 0, 55404
AppSec [candidate] (61.822 ms) : 0, 61822
Remote Config [baseline] (695.022 µs) : 0, 695
Remote Config [candidate] (678.555 µs) : 0, 679
Telemetry [baseline] (12.303 ms) : 0, 12303
Telemetry [candidate] (9.154 ms) : 0, 9154
section appsec
BytebuddyAgent [baseline] (732.85 ms) : 0, 732850
BytebuddyAgent [candidate] (729.092 ms) : 0, 729092
GlobalTracer [baseline] (236.325 ms) : 0, 236325
GlobalTracer [candidate] (236.706 ms) : 0, 236706
AppSec [baseline] (176.789 ms) : 0, 176789
AppSec [candidate] (148.495 ms) : 0, 148495
Remote Config [baseline] (656.675 µs) : 0, 657
Remote Config [candidate] (649.939 µs) : 0, 650
Telemetry [baseline] (8.229 ms) : 0, 8229
Telemetry [candidate] (8.162 ms) : 0, 8162
IAST [baseline] (21.184 ms) : 0, 21184
IAST [candidate] (21.5 ms) : 0, 21500
section iast
BytebuddyAgent [baseline] (837.966 ms) : 0, 837966
BytebuddyAgent [candidate] (832.712 ms) : 0, 832712
GlobalTracer [baseline] (231.104 ms) : 0, 231104
GlobalTracer [candidate] (234.807 ms) : 0, 234807
AppSec [baseline] (57.377 ms) : 0, 57377
AppSec [candidate] (49.135 ms) : 0, 49135
Remote Config [baseline] (623.546 µs) : 0, 624
Remote Config [candidate] (623.92 µs) : 0, 624
Telemetry [baseline] (8.778 ms) : 0, 8778
Telemetry [candidate] (8.762 ms) : 0, 8762
IAST [baseline] (22.872 ms) : 0, 22872
IAST [candidate] (29.431 ms) : 0, 29431
section profiling
ProfilingAgent [baseline] (95.86 ms) : 0, 95860
ProfilingAgent [candidate] (100.733 ms) : 0, 100733
BytebuddyAgent [baseline] (708.804 ms) : 0, 708804
BytebuddyAgent [candidate] (710.765 ms) : 0, 710765
GlobalTracer [baseline] (350.407 ms) : 0, 350407
GlobalTracer [candidate] (328.292 ms) : 0, 328292
AppSec [baseline] (55.291 ms) : 0, 55291
AppSec [candidate] (53.432 ms) : 0, 53432
Remote Config [baseline] (672.56 µs) : 0, 673
Remote Config [candidate] (663.867 µs) : 0, 664
Telemetry [baseline] (8.942 ms) : 0, 8942
Telemetry [candidate] (8.901 ms) : 0, 8901
Profiling [baseline] (95.887 ms) : 0, 95887
Profiling [candidate] (100.761 ms) : 0, 100761
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~a938c8e65e, baseline=1.47.0-SNAPSHOT~19ce7f1a2a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048630
Total [baseline] (8.684 s) : 0, 8683549
Agent [candidate] (1.045 s) : 0, 1044562
Total [candidate] (8.617 s) : 0, 8617261
section iast
Agent [baseline] (1.182 s) : 0, 1182126
Total [baseline] (9.267 s) : 0, 9267149
Agent [candidate] (1.159 s) : 0, 1159324
Total [candidate] (9.196 s) : 0, 9195618
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1170951
Total [baseline] (9.235 s) : 0, 9235288
Agent [candidate] (1.162 s) : 0, 1161553
Total [candidate] (9.153 s) : 0, 9153293
section iast_TELEMETRY_OFF
Agent [baseline] (1.184 s) : 0, 1184075
Total [baseline] (9.248 s) : 0, 9248152
Agent [candidate] (1.16 s) : 0, 1160308
Total [candidate] (9.211 s) : 0, 9211459
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.182 s 133.496 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 122.321 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.184 s 135.445 ms (12.9%)
Total tracing 8.684 s -
Total iast 9.267 s 583.6 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.235 s 551.739 ms (6.4%)
Total iast_TELEMETRY_OFF 9.248 s 564.603 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.159 s 114.762 ms (11.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.162 s 116.991 ms (11.2%)
Agent iast_TELEMETRY_OFF 1.16 s 115.745 ms (11.1%)
Total tracing 8.617 s -
Total iast 9.196 s 578.357 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.153 s 536.032 ms (6.2%)
Total iast_TELEMETRY_OFF 9.211 s 594.198 ms (6.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~a938c8e65e, baseline=1.47.0-SNAPSHOT~19ce7f1a2a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (722.926 ms) : 0, 722926
BytebuddyAgent [candidate] (721.172 ms) : 0, 721172
GlobalTracer [baseline] (239.99 ms) : 0, 239990
GlobalTracer [candidate] (237.112 ms) : 0, 237112
AppSec [baseline] (55.412 ms) : 0, 55412
AppSec [candidate] (61.112 ms) : 0, 61112
Remote Config [baseline] (689.333 µs) : 0, 689
Remote Config [candidate] (656.654 µs) : 0, 657
Telemetry [baseline] (14.255 ms) : 0, 14255
Telemetry [candidate] (9.593 ms) : 0, 9593
section iast
BytebuddyAgent [baseline] (845.076 ms) : 0, 845076
BytebuddyAgent [candidate] (824.673 ms) : 0, 824673
GlobalTracer [baseline] (231.731 ms) : 0, 231731
GlobalTracer [candidate] (232.927 ms) : 0, 232927
IAST [baseline] (23.232 ms) : 0, 23232
IAST [candidate] (29.145 ms) : 0, 29145
AppSec [baseline] (57.393 ms) : 0, 57393
AppSec [candidate] (48.43 ms) : 0, 48430
Remote Config [baseline] (606.661 µs) : 0, 607
Remote Config [candidate] (606.175 µs) : 0, 606
Telemetry [baseline] (8.697 ms) : 0, 8697
Telemetry [candidate] (8.766 ms) : 0, 8766
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.279 ms) : 0, 836279
BytebuddyAgent [candidate] (825.807 ms) : 0, 825807
GlobalTracer [baseline] (230.456 ms) : 0, 230456
GlobalTracer [candidate] (232.477 ms) : 0, 232477
IAST [baseline] (22.589 ms) : 0, 22589
IAST [candidate] (30.207 ms) : 0, 30207
AppSec [baseline] (57.247 ms) : 0, 57247
AppSec [candidate] (48.842 ms) : 0, 48842
Remote Config [baseline] (596.162 µs) : 0, 596
Remote Config [candidate] (619.215 µs) : 0, 619
Telemetry [baseline] (8.547 ms) : 0, 8547
Telemetry [candidate] (8.766 ms) : 0, 8766
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (845.816 ms) : 0, 845816
BytebuddyAgent [candidate] (825.015 ms) : 0, 825015
GlobalTracer [baseline] (233.017 ms) : 0, 233017
GlobalTracer [candidate] (231.652 ms) : 0, 231652
IAST [baseline] (24.894 ms) : 0, 24894
IAST [candidate] (30.687 ms) : 0, 30687
AppSec [baseline] (55.421 ms) : 0, 55421
AppSec [candidate] (48.843 ms) : 0, 48843
Remote Config [baseline] (626.593 µs) : 0, 627
Remote Config [candidate] (610.742 µs) : 0, 611
Telemetry [baseline] (8.769 ms) : 0, 8769
Telemetry [candidate] (8.643 ms) : 0, 8643
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-22T12:31:14 2025-02-22T12:38:16
git_branch master paullgdc/stable_config/common_component
git_commit_date 1740159057 1740226798
git_commit_sha 19ce7f1 a938c8e
release_version 1.47.0-SNAPSHOT~19ce7f1a2a 1.47.0-SNAPSHOT~a938c8e65e
start_time 2025-02-22T12:31:00 2025-02-22T12:38:02
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740228257 1740228257
ci_job_id 818981373 818981373
ci_pipeline_id 56667511 56667511
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-pnecau8x-project-304-concurrent-0-x0xyn4eu 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-pnecau8x-project-304-concurrent-0-x0xyn4eu 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+62.284µs; +114.011µs] or [+4.172%; +7.636%]		 unstable
[-663.036op/s; +435.116op/s] or [-21.549%; +14.141%]		 1.581ms 2962.963op/s 1.493ms 3076.923op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~a938c8e65e, baseline=1.47.0-SNAPSHOT~19ce7f1a2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (382.61 µs) : 363, 403
.   : milestone, 383,
iast (505.558 µs) : 484, 527
.   : milestone, 506,
iast_FULL (734.469 µs) : 713, 756
.   : milestone, 734,
iast_GLOBAL (558.144 µs) : 536, 580
.   : milestone, 558,
iast_HARDCODED_SECRET_DISABLED (508.266 µs) : 485, 532
.   : milestone, 508,
iast_INACTIVE (463.147 µs) : 441, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (497.619 µs) : 474, 521
.   : milestone, 498,
tracing (454.154 µs) : 432, 476
.   : milestone, 454,
section candidate
no_agent (376.802 µs) : 357, 397
.   : milestone, 377,
iast (509.105 µs) : 487, 531
.   : milestone, 509,
iast_FULL (747.389 µs) : 725, 770
.   : milestone, 747,
iast_GLOBAL (553.401 µs) : 531, 576
.   : milestone, 553,
iast_HARDCODED_SECRET_DISABLED (512.979 µs) : 491, 534
.   : milestone, 513,
iast_INACTIVE (467.411 µs) : 445, 489
.   : milestone, 467,
iast_TELEMETRY_OFF (496.874 µs) : 475, 519
.   : milestone, 497,
tracing (452.252 µs) : 431, 473
.   : milestone, 452,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 382.61 µs [362.592 µs, 402.629 µs] -
iast 505.558 µs [483.882 µs, 527.234 µs] 122.948 µs (32.1%)
iast_FULL 734.469 µs [712.594 µs, 756.343 µs] 351.858 µs (92.0%)
iast_GLOBAL 558.144 µs [536.125 µs, 580.164 µs] 175.534 µs (45.9%)
iast_HARDCODED_SECRET_DISABLED 508.266 µs [484.675 µs, 531.857 µs] 125.656 µs (32.8%)
iast_INACTIVE 463.147 µs [441.385 µs, 484.91 µs] 80.537 µs (21.0%)
iast_TELEMETRY_OFF 497.619 µs [474.128 µs, 521.11 µs] 115.009 µs (30.1%)
tracing 454.154 µs [432.383 µs, 475.925 µs] 71.544 µs (18.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.802 µs [356.825 µs, 396.78 µs] -
iast 509.105 µs [487.169 µs, 531.041 µs] 132.303 µs (35.1%)
iast_FULL 747.389 µs [725.144 µs, 769.634 µs] 370.587 µs (98.4%)
iast_GLOBAL 553.401 µs [531.258 µs, 575.544 µs] 176.599 µs (46.9%)
iast_HARDCODED_SECRET_DISABLED 512.979 µs [491.491 µs, 534.466 µs] 136.176 µs (36.1%)
iast_INACTIVE 467.411 µs [445.472 µs, 489.349 µs] 90.609 µs (24.0%)
iast_TELEMETRY_OFF 496.874 µs [474.507 µs, 519.24 µs] 120.071 µs (31.9%)
tracing 452.252 µs [431.3 µs, 473.204 µs] 75.449 µs (20.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~a938c8e65e, baseline=1.47.0-SNAPSHOT~19ce7f1a2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.349 ms) : 1329, 1370
.   : milestone, 1349,
appsec (1.742 ms) : 1718, 1766
.   : milestone, 1742,
appsec_no_iast (1.761 ms) : 1737, 1785
.   : milestone, 1761,
iast (1.506 ms) : 1482, 1530
.   : milestone, 1506,
profiling (1.493 ms) : 1469, 1517
.   : milestone, 1493,
tracing (1.485 ms) : 1459, 1510
.   : milestone, 1485,
section candidate
no_agent (1.369 ms) : 1349, 1389
.   : milestone, 1369,
appsec (1.744 ms) : 1720, 1767
.   : milestone, 1744,
appsec_no_iast (1.761 ms) : 1737, 1786
.   : milestone, 1761,
iast (1.52 ms) : 1495, 1546
.   : milestone, 1520,
profiling (1.581 ms) : 1557, 1605
.   : milestone, 1581,
tracing (1.488 ms) : 1463, 1512
.   : milestone, 1488,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.349 ms [1.329 ms, 1.37 ms] -
appsec 1.742 ms [1.718 ms, 1.766 ms] 392.598 µs (29.1%)
appsec_no_iast 1.761 ms [1.737 ms, 1.785 ms] 411.948 µs (30.5%)
iast 1.506 ms [1.482 ms, 1.53 ms] 156.886 µs (11.6%)
profiling 1.493 ms [1.469 ms, 1.517 ms] 143.63 µs (10.6%)
tracing 1.485 ms [1.459 ms, 1.51 ms] 135.439 µs (10.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.369 ms [1.349 ms, 1.389 ms] -
appsec 1.744 ms [1.72 ms, 1.767 ms] 374.473 µs (27.4%)
appsec_no_iast 1.761 ms [1.737 ms, 1.786 ms] 392.309 µs (28.7%)
iast 1.52 ms [1.495 ms, 1.546 ms] 150.984 µs (11.0%)
profiling 1.581 ms [1.557 ms, 1.605 ms] 211.972 µs (15.5%)
tracing 1.488 ms [1.463 ms, 1.512 ms] 118.716 µs (8.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master paullgdc/stable_config/common_component
git_commit_date 1740159057 1740226798
git_commit_sha 19ce7f1 a938c8e
release_version 1.47.0-SNAPSHOT~19ce7f1a2a 1.47.0-SNAPSHOT~a938c8e65e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1740228867 1740228867
ci_job_id 818981374 818981374
ci_pipeline_id 56667511 56667511
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dmysf8yn-project-304-concurrent-0-nmbtlw60 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dmysf8yn-project-304-concurrent-0-nmbtlw60 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~a938c8e65e, baseline=1.47.0-SNAPSHOT~19ce7f1a2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.373 ms) : 2330, 2417
.   : milestone, 2373,
iast (2.114 ms) : 2059, 2169
.   : milestone, 2114,
iast_GLOBAL (2.149 ms) : 2094, 2204
.   : milestone, 2149,
profiling (1.994 ms) : 1950, 2039
.   : milestone, 1994,
tracing (1.94 ms) : 1898, 1982
.   : milestone, 1940,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (2.355 ms) : 2312, 2398
.   : milestone, 2355,
iast (2.114 ms) : 2059, 2169
.   : milestone, 2114,
iast_GLOBAL (2.17 ms) : 2114, 2226
.   : milestone, 2170,
profiling (1.976 ms) : 1932, 2020
.   : milestone, 1976,
tracing (1.951 ms) : 1909, 1993
.   : milestone, 1951,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.373 ms [2.33 ms, 2.417 ms] 901.915 µs (61.3%)
iast 2.114 ms [2.059 ms, 2.169 ms] 642.443 µs (43.7%)
iast_GLOBAL 2.149 ms [2.094 ms, 2.204 ms] 677.363 µs (46.0%)
profiling 1.994 ms [1.95 ms, 2.039 ms] 523.013 µs (35.5%)
tracing 1.94 ms [1.898 ms, 1.982 ms] 468.44 µs (31.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 2.355 ms [2.312 ms, 2.398 ms] 880.21 µs (59.7%)
iast 2.114 ms [2.059 ms, 2.169 ms] 638.9 µs (43.3%)
iast_GLOBAL 2.17 ms [2.114 ms, 2.226 ms] 695.154 µs (47.1%)
profiling 1.976 ms [1.932 ms, 2.02 ms] 501.283 µs (34.0%)
tracing 1.951 ms [1.909 ms, 1.993 ms] 476.596 µs (32.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~a938c8e65e, baseline=1.47.0-SNAPSHOT~19ce7f1a2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.606 s) : 15606000, 15606000
.   : milestone, 15606000,
appsec (15.081 s) : 15081000, 15081000
.   : milestone, 15081000,
iast (18.906 s) : 18906000, 18906000
.   : milestone, 18906000,
iast_GLOBAL (17.627 s) : 17627000, 17627000
.   : milestone, 17627000,
profiling (15.137 s) : 15137000, 15137000
.   : milestone, 15137000,
tracing (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
section candidate
no_agent (15.491 s) : 15491000, 15491000
.   : milestone, 15491000,
appsec (15.179 s) : 15179000, 15179000
.   : milestone, 15179000,
iast (18.868 s) : 18868000, 18868000
.   : milestone, 18868000,
iast_GLOBAL (18.548 s) : 18548000, 18548000
.   : milestone, 18548000,
profiling (15.222 s) : 15222000, 15222000
.   : milestone, 15222000,
tracing (14.698 s) : 14698000, 14698000
.   : milestone, 14698000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.606 s [15.606 s, 15.606 s] -
appsec 15.081 s [15.081 s, 15.081 s] -525.0 ms (-3.4%)
iast 18.906 s [18.906 s, 18.906 s] 3.3 s (21.1%)
iast_GLOBAL 17.627 s [17.627 s, 17.627 s] 2.021 s (13.0%)
profiling 15.137 s [15.137 s, 15.137 s] -469.0 ms (-3.0%)
tracing 15.036 s [15.036 s, 15.036 s] -570.0 ms (-3.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.491 s [15.491 s, 15.491 s] -
appsec 15.179 s [15.179 s, 15.179 s] -312.0 ms (-2.0%)
iast 18.868 s [18.868 s, 18.868 s] 3.377 s (21.8%)
iast_GLOBAL 18.548 s [18.548 s, 18.548 s] 3.057 s (19.7%)
profiling 15.222 s [15.222 s, 15.222 s] -269.0 ms (-1.7%)
tracing 14.698 s [14.698 s, 14.698 s] -793.0 ms (-5.1%)

@BaptisteFoy BaptisteFoy force-pushed the paullgdc/stable_config/common_component branch from a938c8e to 8585b4d Compare February 22, 2025 14:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@BaptisteFoy @paullegranddc