Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for scanning jar from loaded class #8370

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

jpbempel
Copy link
Member

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Feb 11, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1739448936 1739449307
end_time 2025-02-13T12:16:54 2025-02-13T12:23:03
git_branch master jpbempel/symdb-scan-jar
git_commit_sha a3d58f1 144ab64
start_time 2025-02-13T12:15:37 2025-02-13T12:21:47
See matching parameters
Baseline Candidate
ci_job_id 806812440 806812440
ci_pipeline_id 55801856 55801856
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1739448180 1739448180

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 7 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-49.203µs; +51.454µs] or [-17.382%; +18.177%]
unstable
[-67049.316ns; +65357.050ns] or [-20.467%; +19.951%]
unstable
[-75941.663ns; +75440.786ns] or [-22.175%; +22.029%]
unstable
[-533.302µs; +881.287µs] or [-74.034%; +122.341%]
same
scenario:basic same same unstable
[-15.750µs; +23.879µs] or [-4.892%; +7.417%]
unstable
[-108.113µs; +155.913µs] or [-19.766%; +28.505%]
unstable
[-194.005op/s; +194.005op/s] or [-7.760%; +7.760%]
scenario:loop same same same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (327.594 µs) : 272, 384
.   : milestone, 328,
basic (311.558 µs) : 297, 326
.   : milestone, 312,
loop (10.146 ms) : 10094, 10199
.   : milestone, 10146,
section candidate
noprobe (326.748 µs) : 257, 396
.   : milestone, 327,
basic (313.799 µs) : 299, 328
.   : milestone, 314,
loop (10.152 ms) : 10096, 10207
.   : milestone, 10152,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 327.594 µs [271.615 µs, 383.572 µs]
basic 311.558 µs [296.769 µs, 326.347 µs]
loop 10.146 ms [10.094 ms, 10.199 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 326.748 µs [257.259 µs, 396.237 µs]
basic 313.799 µs [299.418 µs, 328.18 µs]
loop 10.152 ms [10.096 ms, 10.207 ms]

@pr-commenter
Copy link

pr-commenter bot commented Feb 11, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/symdb-scan-jar
git_commit_date 1739441046 1739448180
git_commit_sha a3d58f1 144ab64
release_version 1.47.0-SNAPSHOT~a3d58f1cfd 1.47.0-SNAPSHOT~144ab64a97
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739450816 1739450816
ci_job_id 806812434 806812434
ci_pipeline_id 55801856 55801856
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-j9jhtink-project-304-concurrent-0-v1uqy5op 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-j9jhtink-project-304-concurrent-0-v1uqy5op 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~144ab64a97, baseline=1.47.0-SNAPSHOT~a3d58f1cfd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1045816
Total [baseline] (8.664 s) : 0, 8663910
Agent [candidate] (1.052 s) : 0, 1052321
Total [candidate] (8.636 s) : 0, 8636422
section iast
Agent [baseline] (1.181 s) : 0, 1180854
Total [baseline] (9.306 s) : 0, 9306370
Agent [candidate] (1.176 s) : 0, 1175958
Total [candidate] (9.37 s) : 0, 9369547
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1170855
Total [baseline] (9.23 s) : 0, 9229806
Agent [candidate] (1.175 s) : 0, 1175021
Total [candidate] (9.215 s) : 0, 9214620
section iast_TELEMETRY_OFF
Agent [baseline] (1.17 s) : 0, 1170449
Total [baseline] (9.239 s) : 0, 9238925
Agent [candidate] (1.17 s) : 0, 1169720
Total [candidate] (9.246 s) : 0, 9245684
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent iast 1.181 s 135.038 ms (12.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 125.039 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.17 s 124.633 ms (11.9%)
Total tracing 8.664 s -
Total iast 9.306 s 642.46 ms (7.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.23 s 565.895 ms (6.5%)
Total iast_TELEMETRY_OFF 9.239 s 575.015 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent iast 1.176 s 123.636 ms (11.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.175 s 122.7 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.17 s 117.399 ms (11.2%)
Total tracing 8.636 s -
Total iast 9.37 s 733.126 ms (8.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.215 s 578.198 ms (6.7%)
Total iast_TELEMETRY_OFF 9.246 s 609.262 ms (7.1%)
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~144ab64a97, baseline=1.47.0-SNAPSHOT~a3d58f1cfd

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (719.646 ms) : 0, 719646
BytebuddyAgent [candidate] (722.587 ms) : 0, 722587
GlobalTracer [baseline] (241.639 ms) : 0, 241639
GlobalTracer [candidate] (244.556 ms) : 0, 244556
AppSec [baseline] (55.51 ms) : 0, 55510
AppSec [candidate] (55.292 ms) : 0, 55292
Remote Config [baseline] (718.646 µs) : 0, 719
Remote Config [candidate] (719.159 µs) : 0, 719
Telemetry [baseline] (13.049 ms) : 0, 13049
Telemetry [candidate] (13.825 ms) : 0, 13825
section iast
BytebuddyAgent [baseline] (842.963 ms) : 0, 842963
BytebuddyAgent [candidate] (836.79 ms) : 0, 836790
GlobalTracer [baseline] (232.6 ms) : 0, 232600
GlobalTracer [candidate] (234.14 ms) : 0, 234140
IAST [baseline] (22.978 ms) : 0, 22978
IAST [candidate] (22.977 ms) : 0, 22977
AppSec [baseline] (57.506 ms) : 0, 57506
AppSec [candidate] (57.318 ms) : 0, 57318
Remote Config [baseline] (619.106 µs) : 0, 619
Remote Config [candidate] (635.823 µs) : 0, 636
Telemetry [baseline] (8.878 ms) : 0, 8878
Telemetry [candidate] (8.83 ms) : 0, 8830
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.81 ms) : 0, 834810
BytebuddyAgent [candidate] (836.087 ms) : 0, 836087
GlobalTracer [baseline] (231.093 ms) : 0, 231093
GlobalTracer [candidate] (234.117 ms) : 0, 234117
IAST [baseline] (22.775 ms) : 0, 22775
IAST [candidate] (23.037 ms) : 0, 23037
AppSec [baseline] (57.503 ms) : 0, 57503
AppSec [candidate] (57.163 ms) : 0, 57163
Remote Config [baseline] (631.059 µs) : 0, 631
Remote Config [candidate] (628.51 µs) : 0, 629
Telemetry [baseline] (8.765 ms) : 0, 8765
Telemetry [candidate] (8.734 ms) : 0, 8734
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (834.548 ms) : 0, 834548
BytebuddyAgent [candidate] (832.378 ms) : 0, 832378
GlobalTracer [baseline] (232.178 ms) : 0, 232178
GlobalTracer [candidate] (233.881 ms) : 0, 233881
IAST [baseline] (26.098 ms) : 0, 26098
IAST [candidate] (26.715 ms) : 0, 26715
AppSec [baseline] (53.174 ms) : 0, 53174
AppSec [candidate] (52.211 ms) : 0, 52211
Remote Config [baseline] (605.294 µs) : 0, 605
Remote Config [candidate] (622.502 µs) : 0, 623
Telemetry [baseline] (8.596 ms) : 0, 8596
Telemetry [candidate] (8.64 ms) : 0, 8640
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~144ab64a97, baseline=1.47.0-SNAPSHOT~a3d58f1cfd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.041 s) : 0, 1041087
Total [baseline] (10.482 s) : 0, 10481784
Agent [candidate] (1.052 s) : 0, 1052128
Total [candidate] (10.501 s) : 0, 10500620
section appsec
Agent [baseline] (1.189 s) : 0, 1189245
Total [baseline] (10.849 s) : 0, 10849087
Agent [candidate] (1.191 s) : 0, 1191023
Total [candidate] (10.788 s) : 0, 10787830
section iast
Agent [baseline] (1.173 s) : 0, 1172671
Total [baseline] (11.085 s) : 0, 11084887
Agent [candidate] (1.176 s) : 0, 1176338
Total [candidate] (11.085 s) : 0, 11085453
section profiling
Agent [baseline] (1.276 s) : 0, 1276282
Total [baseline] (10.879 s) : 0, 10879476
Agent [candidate] (1.28 s) : 0, 1279993
Total [candidate] (10.949 s) : 0, 10948944
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent appsec 1.189 s 148.159 ms (14.2%)
Agent iast 1.173 s 131.584 ms (12.6%)
Agent profiling 1.276 s 235.195 ms (22.6%)
Total tracing 10.482 s -
Total appsec 10.849 s 367.303 ms (3.5%)
Total iast 11.085 s 603.103 ms (5.8%)
Total profiling 10.879 s 397.692 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.191 s 138.895 ms (13.2%)
Agent iast 1.176 s 124.21 ms (11.8%)
Agent profiling 1.28 s 227.865 ms (21.7%)
Total tracing 10.501 s -
Total appsec 10.788 s 287.21 ms (2.7%)
Total iast 11.085 s 584.833 ms (5.6%)
Total profiling 10.949 s 448.324 ms (4.3%)
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~144ab64a97, baseline=1.47.0-SNAPSHOT~a3d58f1cfd

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.2 ms) : 0, 717200
BytebuddyAgent [candidate] (723.296 ms) : 0, 723296
GlobalTracer [baseline] (241.18 ms) : 0, 241180
GlobalTracer [candidate] (245.338 ms) : 0, 245338
AppSec [baseline] (55.872 ms) : 0, 55872
AppSec [candidate] (55.749 ms) : 0, 55749
Remote Config [baseline] (735.129 µs) : 0, 735
Remote Config [candidate] (723.545 µs) : 0, 724
Telemetry [baseline] (10.858 ms) : 0, 10858
Telemetry [candidate] (11.612 ms) : 0, 11612
section appsec
BytebuddyAgent [baseline] (738.912 ms) : 0, 738912
BytebuddyAgent [candidate] (737.824 ms) : 0, 737824
GlobalTracer [baseline] (238.576 ms) : 0, 238576
GlobalTracer [candidate] (241.391 ms) : 0, 241391
AppSec [baseline] (176.451 ms) : 0, 176451
AppSec [candidate] (176.293 ms) : 0, 176293
Remote Config [baseline] (653.188 µs) : 0, 653
Remote Config [candidate] (662.337 µs) : 0, 662
Telemetry [baseline] (8.291 ms) : 0, 8291
Telemetry [candidate] (8.699 ms) : 0, 8699
IAST [baseline] (22.014 ms) : 0, 22014
IAST [candidate] (21.679 ms) : 0, 21679
section iast
BytebuddyAgent [baseline] (836.414 ms) : 0, 836414
BytebuddyAgent [candidate] (837.284 ms) : 0, 837284
GlobalTracer [baseline] (231.634 ms) : 0, 231634
GlobalTracer [candidate] (234.266 ms) : 0, 234266
AppSec [baseline] (57.235 ms) : 0, 57235
AppSec [candidate] (57.252 ms) : 0, 57252
Remote Config [baseline] (612.363 µs) : 0, 612
Remote Config [candidate] (623.963 µs) : 0, 624
Telemetry [baseline] (8.824 ms) : 0, 8824
Telemetry [candidate] (8.737 ms) : 0, 8737
IAST [baseline] (22.762 ms) : 0, 22762
IAST [candidate] (22.849 ms) : 0, 22849
section profiling
ProfilingAgent [baseline] (97.253 ms) : 0, 97253
ProfilingAgent [candidate] (96.495 ms) : 0, 96495
BytebuddyAgent [baseline] (714.529 ms) : 0, 714529
BytebuddyAgent [candidate] (718.025 ms) : 0, 718025
GlobalTracer [baseline] (355.682 ms) : 0, 355682
GlobalTracer [candidate] (357.96 ms) : 0, 357960
AppSec [baseline] (56.209 ms) : 0, 56209
AppSec [candidate] (54.934 ms) : 0, 54934
Remote Config [baseline] (716.648 µs) : 0, 717
Remote Config [candidate] (717.781 µs) : 0, 718
Telemetry [baseline] (9.041 ms) : 0, 9041
Telemetry [candidate] (9.009 ms) : 0, 9009
Profiling [baseline] (97.277 ms) : 0, 97277
Profiling [candidate] (96.519 ms) : 0, 96519
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-13T12:16:41 2025-02-13T12:23:46
git_branch master jpbempel/symdb-scan-jar
git_commit_date 1739441046 1739448180
git_commit_sha a3d58f1 144ab64
release_version 1.47.0-SNAPSHOT~a3d58f1cfd 1.47.0-SNAPSHOT~144ab64a97
start_time 2025-02-13T12:16:28 2025-02-13T12:23:32
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739449782 1739449782
ci_job_id 806812435 806812435
ci_pipeline_id 55801856 55801856
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-inwry3gs-project-304-concurrent-0-cjmpkkeh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-inwry3gs-project-304-concurrent-0-cjmpkkeh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~144ab64a97, baseline=1.47.0-SNAPSHOT~a3d58f1cfd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.358 ms) : 1338, 1378
.   : milestone, 1358,
appsec (1.754 ms) : 1732, 1777
.   : milestone, 1754,
appsec_no_iast (1.733 ms) : 1710, 1756
.   : milestone, 1733,
iast (1.501 ms) : 1476, 1526
.   : milestone, 1501,
profiling (1.537 ms) : 1512, 1562
.   : milestone, 1537,
tracing (1.506 ms) : 1482, 1530
.   : milestone, 1506,
section candidate
no_agent (1.351 ms) : 1331, 1372
.   : milestone, 1351,
appsec (1.758 ms) : 1734, 1781
.   : milestone, 1758,
appsec_no_iast (1.73 ms) : 1705, 1755
.   : milestone, 1730,
iast (1.498 ms) : 1473, 1524
.   : milestone, 1498,
profiling (1.5 ms) : 1477, 1524
.   : milestone, 1500,
tracing (1.486 ms) : 1461, 1511
.   : milestone, 1486,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.338 ms, 1.378 ms] -
appsec 1.754 ms [1.732 ms, 1.777 ms] 396.393 µs (29.2%)
appsec_no_iast 1.733 ms [1.71 ms, 1.756 ms] 374.614 µs (27.6%)
iast 1.501 ms [1.476 ms, 1.526 ms] 142.893 µs (10.5%)
profiling 1.537 ms [1.512 ms, 1.562 ms] 178.954 µs (13.2%)
tracing 1.506 ms [1.482 ms, 1.53 ms] 147.961 µs (10.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.351 ms [1.331 ms, 1.372 ms] -
appsec 1.758 ms [1.734 ms, 1.781 ms] 406.347 µs (30.1%)
appsec_no_iast 1.73 ms [1.705 ms, 1.755 ms] 378.394 µs (28.0%)
iast 1.498 ms [1.473 ms, 1.524 ms] 146.933 µs (10.9%)
profiling 1.5 ms [1.477 ms, 1.524 ms] 149.113 µs (11.0%)
tracing 1.486 ms [1.461 ms, 1.511 ms] 134.387 µs (9.9%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~144ab64a97, baseline=1.47.0-SNAPSHOT~a3d58f1cfd
    dateFormat X
    axisFormat %s
section baseline
no_agent (376.48 µs) : 357, 396
.   : milestone, 376,
iast (501.073 µs) : 479, 523
.   : milestone, 501,
iast_FULL (739.701 µs) : 718, 762
.   : milestone, 740,
iast_GLOBAL (557.029 µs) : 534, 580
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (503.582 µs) : 482, 525
.   : milestone, 504,
iast_INACTIVE (462.809 µs) : 440, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (496.088 µs) : 473, 520
.   : milestone, 496,
tracing (452.589 µs) : 432, 474
.   : milestone, 453,
section candidate
no_agent (376.685 µs) : 357, 396
.   : milestone, 377,
iast (499.631 µs) : 478, 521
.   : milestone, 500,
iast_FULL (742.875 µs) : 721, 765
.   : milestone, 743,
iast_GLOBAL (549.218 µs) : 527, 571
.   : milestone, 549,
iast_HARDCODED_SECRET_DISABLED (498.23 µs) : 477, 520
.   : milestone, 498,
iast_INACTIVE (456.071 µs) : 434, 478
.   : milestone, 456,
iast_TELEMETRY_OFF (494.148 µs) : 470, 518
.   : milestone, 494,
tracing (448.787 µs) : 427, 470
.   : milestone, 449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.48 µs [356.681 µs, 396.278 µs] -
iast 501.073 µs [479.295 µs, 522.852 µs] 124.594 µs (33.1%)
iast_FULL 739.701 µs [717.833 µs, 761.57 µs] 363.222 µs (96.5%)
iast_GLOBAL 557.029 µs [533.566 µs, 580.491 µs] 180.549 µs (48.0%)
iast_HARDCODED_SECRET_DISABLED 503.582 µs [482.23 µs, 524.934 µs] 127.102 µs (33.8%)
iast_INACTIVE 462.809 µs [440.245 µs, 485.373 µs] 86.329 µs (22.9%)
iast_TELEMETRY_OFF 496.088 µs [472.616 µs, 519.561 µs] 119.608 µs (31.8%)
tracing 452.589 µs [431.503 µs, 473.676 µs] 76.11 µs (20.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.685 µs [357.195 µs, 396.176 µs] -
iast 499.631 µs [478.052 µs, 521.209 µs] 122.945 µs (32.6%)
iast_FULL 742.875 µs [720.702 µs, 765.047 µs] 366.19 µs (97.2%)
iast_GLOBAL 549.218 µs [527.418 µs, 571.017 µs] 172.532 µs (45.8%)
iast_HARDCODED_SECRET_DISABLED 498.23 µs [476.774 µs, 519.686 µs] 121.545 µs (32.3%)
iast_INACTIVE 456.071 µs [433.9 µs, 478.241 µs] 79.385 µs (21.1%)
iast_TELEMETRY_OFF 494.148 µs [470.486 µs, 517.81 µs] 117.463 µs (31.2%)
tracing 448.787 µs [427.254 µs, 470.319 µs] 72.101 µs (19.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/symdb-scan-jar
git_commit_date 1739441046 1739448180
git_commit_sha a3d58f1 144ab64
release_version 1.47.0-SNAPSHOT~a3d58f1cfd 1.47.0-SNAPSHOT~144ab64a97
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1739450337 1739450337
ci_job_id 806812436 806812436
ci_pipeline_id 55801856 55801856
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-j9jhtink-project-304-concurrent-1-f6h545a2 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-j9jhtink-project-304-concurrent-1-f6h545a2 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~144ab64a97, baseline=1.47.0-SNAPSHOT~a3d58f1cfd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.371 ms) : 2328, 2415
.   : milestone, 2371,
iast (2.119 ms) : 2065, 2174
.   : milestone, 2119,
iast_GLOBAL (2.157 ms) : 2102, 2212
.   : milestone, 2157,
profiling (2.436 ms) : 2191, 2680
.   : milestone, 2436,
tracing (1.954 ms) : 1911, 1996
.   : milestone, 1954,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (2.372 ms) : 2329, 2415
.   : milestone, 2372,
iast (2.129 ms) : 2074, 2184
.   : milestone, 2129,
iast_GLOBAL (2.16 ms) : 2105, 2216
.   : milestone, 2160,
profiling (1.975 ms) : 1932, 2019
.   : milestone, 1975,
tracing (1.95 ms) : 1908, 1992
.   : milestone, 1950,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 2.371 ms [2.328 ms, 2.415 ms] 898.53 µs (61.0%)
iast 2.119 ms [2.065 ms, 2.174 ms] 646.64 µs (43.9%)
iast_GLOBAL 2.157 ms [2.102 ms, 2.212 ms] 684.027 µs (46.4%)
profiling 2.436 ms [2.191 ms, 2.68 ms] 962.71 µs (65.4%)
tracing 1.954 ms [1.911 ms, 1.996 ms] 480.738 µs (32.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 2.372 ms [2.329 ms, 2.415 ms] 893.829 µs (60.5%)
iast 2.129 ms [2.074 ms, 2.184 ms] 650.274 µs (44.0%)
iast_GLOBAL 2.16 ms [2.105 ms, 2.216 ms] 681.901 µs (46.1%)
profiling 1.975 ms [1.932 ms, 2.019 ms] 496.713 µs (33.6%)
tracing 1.95 ms [1.908 ms, 1.992 ms] 471.26 µs (31.9%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~144ab64a97, baseline=1.47.0-SNAPSHOT~a3d58f1cfd
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.119 s) : 15119000, 15119000
.   : milestone, 15119000,
appsec (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
iast (18.996 s) : 18996000, 18996000
.   : milestone, 18996000,
iast_GLOBAL (17.996 s) : 17996000, 17996000
.   : milestone, 17996000,
profiling (15.689 s) : 15689000, 15689000
.   : milestone, 15689000,
tracing (15.092 s) : 15092000, 15092000
.   : milestone, 15092000,
section candidate
no_agent (15.205 s) : 15205000, 15205000
.   : milestone, 15205000,
appsec (15.054 s) : 15054000, 15054000
.   : milestone, 15054000,
iast (18.725 s) : 18725000, 18725000
.   : milestone, 18725000,
iast_GLOBAL (17.954 s) : 17954000, 17954000
.   : milestone, 17954000,
profiling (15.633 s) : 15633000, 15633000
.   : milestone, 15633000,
tracing (14.904 s) : 14904000, 14904000
.   : milestone, 14904000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.119 s [15.119 s, 15.119 s] -
appsec 15.057 s [15.057 s, 15.057 s] -62.0 ms (-0.4%)
iast 18.996 s [18.996 s, 18.996 s] 3.877 s (25.6%)
iast_GLOBAL 17.996 s [17.996 s, 17.996 s] 2.877 s (19.0%)
profiling 15.689 s [15.689 s, 15.689 s] 570.0 ms (3.8%)
tracing 15.092 s [15.092 s, 15.092 s] -27.0 ms (-0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.205 s [15.205 s, 15.205 s] -
appsec 15.054 s [15.054 s, 15.054 s] -151.0 ms (-1.0%)
iast 18.725 s [18.725 s, 18.725 s] 3.52 s (23.2%)
iast_GLOBAL 17.954 s [17.954 s, 17.954 s] 2.749 s (18.1%)
profiling 15.633 s [15.633 s, 15.633 s] 428.0 ms (2.8%)
tracing 14.904 s [14.904 s, 14.904 s] -301.0 ms (-2.0%)

@jpbempel jpbempel force-pushed the jpbempel/symdb-scan-jar branch from b3ef438 to b08db2d Compare February 13, 2025 10:47
when a class is loaded we are now locating the jar containing the
class and push the jar to a queue to be scanned by a background thread
like for the initial process of SymDB enablement
Add more information into SymDB report of total class count processed
total jars scanned and histogram of class count by scanned jar
@jpbempel jpbempel force-pushed the jpbempel/symdb-scan-jar branch from b08db2d to 144ab64 Compare February 13, 2025 12:03
@jpbempel jpbempel marked this pull request as ready for review February 13, 2025 15:33
@jpbempel jpbempel requested a review from a team as a code owner February 13, 2025 15:33
@jpbempel jpbempel requested review from shatzi and removed request for a team February 13, 2025 15:33
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel requested a review from evanchooly February 13, 2025 16:00
@jpbempel jpbempel added comp: debugger Dynamic Instrumentation type: enhancement labels Feb 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant