Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix ignite-2.0 latestDepTest compilation #8433

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from
Draft

Fix ignite-2.0 latestDepTest compilation #8433

wants to merge 1 commit into from

Conversation

smola
Copy link
Member

@smola smola commented Feb 21, 2025

What Does This Do

  • Set latestDepTest for ignite-2.0 compile with Java 11+, since ignite-2.17.0+ requires it (discovered on dependency bump: Update Gradle dependencies #8398).
  • Add a new test variant for ignite 2.16.0 (last version compatible with Java 8).
  • Note that latestDepTest do not run with Java 11+. This was an old problem, and still not addressed by this PR.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@smola smola added comp: testing Testing inst: others All other instrumentations tag: no release notes Changes to exclude from release notes labels Feb 21, 2025
@smola smola mentioned this pull request Feb 21, 2025
Open
1 task
@pr-commenter
Copy link

pr-commenter bot commented Feb 21, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ignite-2.0-fix
git_commit_date 1740159057 1740163816
git_commit_sha 19ce7f1 cbdc13b
release_version 1.47.0-SNAPSHOT~19ce7f1a2a 1.47.0-SNAPSHOT~cbdc13b587
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740166253 1740166253
ci_job_id 818436297 818436297
ci_pipeline_id 56610743 56610743
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-64dctnlg-project-304-concurrent-1-5rd3u604 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-64dctnlg-project-304-concurrent-1-5rd3u604 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~cbdc13b587, baseline=1.47.0-SNAPSHOT~19ce7f1a2a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1040287
Total [baseline] (8.663 s) : 0, 8662958
Agent [candidate] (1.042 s) : 0, 1041554
Total [candidate] (8.674 s) : 0, 8674107
section iast
Agent [baseline] (1.179 s) : 0, 1178928
Total [baseline] (9.286 s) : 0, 9285592
Agent [candidate] (1.179 s) : 0, 1179132
Total [candidate] (9.25 s) : 0, 9250173
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1170749
Total [baseline] (9.185 s) : 0, 9184898
Agent [candidate] (1.174 s) : 0, 1173675
Total [candidate] (9.222 s) : 0, 9222249
section iast_TELEMETRY_OFF
Agent [baseline] (1.17 s) : 0, 1169562
Total [baseline] (9.222 s) : 0, 9221633
Agent [candidate] (1.176 s) : 0, 1176411
Total [candidate] (9.283 s) : 0, 9282806
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent iast 1.179 s 138.64 ms (13.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 130.462 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.17 s 129.275 ms (12.4%)
Total tracing 8.663 s -
Total iast 9.286 s 622.635 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.185 s 521.94 ms (6.0%)
Total iast_TELEMETRY_OFF 9.222 s 558.675 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.179 s 137.578 ms (13.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.174 s 132.121 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.176 s 134.856 ms (12.9%)
Total tracing 8.674 s -
Total iast 9.25 s 576.066 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.222 s 548.141 ms (6.3%)
Total iast_TELEMETRY_OFF 9.283 s 608.699 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~cbdc13b587, baseline=1.47.0-SNAPSHOT~19ce7f1a2a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.976 ms) : 0, 716976
BytebuddyAgent [candidate] (718.743 ms) : 0, 718743
GlobalTracer [baseline] (239.121 ms) : 0, 239121
GlobalTracer [candidate] (240.103 ms) : 0, 240103
AppSec [baseline] (55.463 ms) : 0, 55463
AppSec [candidate] (55.388 ms) : 0, 55388
Remote Config [baseline] (699.027 µs) : 0, 699
Remote Config [candidate] (689.518 µs) : 0, 690
Telemetry [baseline] (12.861 ms) : 0, 12861
Telemetry [candidate] (11.43 ms) : 0, 11430
section iast
BytebuddyAgent [baseline] (841.538 ms) : 0, 841538
BytebuddyAgent [candidate] (842.619 ms) : 0, 842619
GlobalTracer [baseline] (231.824 ms) : 0, 231824
GlobalTracer [candidate] (230.977 ms) : 0, 230977
IAST [baseline] (23.04 ms) : 0, 23040
IAST [candidate] (22.815 ms) : 0, 22815
AppSec [baseline] (57.887 ms) : 0, 57887
AppSec [candidate] (57.804 ms) : 0, 57804
Remote Config [baseline] (637.823 µs) : 0, 638
Remote Config [candidate] (636.262 µs) : 0, 636
Telemetry [baseline] (8.753 ms) : 0, 8753
Telemetry [candidate] (8.818 ms) : 0, 8818
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.011 ms) : 0, 836011
BytebuddyAgent [candidate] (837.325 ms) : 0, 837325
GlobalTracer [baseline] (230.016 ms) : 0, 230016
GlobalTracer [candidate] (230.874 ms) : 0, 230874
IAST [baseline] (22.897 ms) : 0, 22897
IAST [candidate] (22.927 ms) : 0, 22927
AppSec [baseline] (57.264 ms) : 0, 57264
AppSec [candidate] (57.882 ms) : 0, 57882
Remote Config [baseline] (611.557 µs) : 0, 612
Remote Config [candidate] (626.327 µs) : 0, 626
Telemetry [baseline] (8.661 ms) : 0, 8661
Telemetry [candidate] (8.752 ms) : 0, 8752
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (835.149 ms) : 0, 835149
BytebuddyAgent [candidate] (839.546 ms) : 0, 839546
GlobalTracer [baseline] (230.612 ms) : 0, 230612
GlobalTracer [candidate] (232.005 ms) : 0, 232005
IAST [baseline] (26.034 ms) : 0, 26034
IAST [candidate] (24.902 ms) : 0, 24902
AppSec [baseline] (53.352 ms) : 0, 53352
AppSec [candidate] (55.231 ms) : 0, 55231
Remote Config [baseline] (608.041 µs) : 0, 608
Remote Config [candidate] (626.219 µs) : 0, 626
Telemetry [baseline] (8.6 ms) : 0, 8600
Telemetry [candidate] (8.761 ms) : 0, 8761
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~cbdc13b587, baseline=1.47.0-SNAPSHOT~19ce7f1a2a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043919
Total [baseline] (10.399 s) : 0, 10399145
Agent [candidate] (1.049 s) : 0, 1048768
Total [candidate] (10.433 s) : 0, 10432930
section appsec
Agent [baseline] (1.188 s) : 0, 1187740
Total [baseline] (10.773 s) : 0, 10773335
Agent [candidate] (1.186 s) : 0, 1185617
Total [candidate] (10.703 s) : 0, 10702809
section iast
Agent [baseline] (1.173 s) : 0, 1172811
Total [baseline] (10.961 s) : 0, 10961180
Agent [candidate] (1.173 s) : 0, 1173152
Total [candidate] (10.947 s) : 0, 10947297
section profiling
Agent [baseline] (1.284 s) : 0, 1284282
Total [baseline] (10.997 s) : 0, 10997469
Agent [candidate] (1.26 s) : 0, 1259520
Total [candidate] (10.845 s) : 0, 10844693
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent appsec 1.188 s 143.821 ms (13.8%)
Agent iast 1.173 s 128.892 ms (12.3%)
Agent profiling 1.284 s 240.362 ms (23.0%)
Total tracing 10.399 s -
Total appsec 10.773 s 374.19 ms (3.6%)
Total iast 10.961 s 562.035 ms (5.4%)
Total profiling 10.997 s 598.324 ms (5.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.186 s 136.849 ms (13.0%)
Agent iast 1.173 s 124.383 ms (11.9%)
Agent profiling 1.26 s 210.752 ms (20.1%)
Total tracing 10.433 s -
Total appsec 10.703 s 269.879 ms (2.6%)
Total iast 10.947 s 514.367 ms (4.9%)
Total profiling 10.845 s 411.763 ms (3.9%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~cbdc13b587, baseline=1.47.0-SNAPSHOT~19ce7f1a2a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (719.798 ms) : 0, 719798
BytebuddyAgent [candidate] (723.507 ms) : 0, 723507
GlobalTracer [baseline] (240.359 ms) : 0, 240359
GlobalTracer [candidate] (241.177 ms) : 0, 241177
AppSec [baseline] (55.736 ms) : 0, 55736
AppSec [candidate] (55.88 ms) : 0, 55880
Remote Config [baseline] (705.391 µs) : 0, 705
Remote Config [candidate] (700.112 µs) : 0, 700
Telemetry [baseline] (12.116 ms) : 0, 12116
Telemetry [candidate] (12.306 ms) : 0, 12306
section appsec
BytebuddyAgent [baseline] (737.209 ms) : 0, 737209
BytebuddyAgent [candidate] (736.993 ms) : 0, 736993
GlobalTracer [baseline] (237.994 ms) : 0, 237994
GlobalTracer [candidate] (236.949 ms) : 0, 236949
IAST [baseline] (21.831 ms) : 0, 21831
IAST [candidate] (21.654 ms) : 0, 21654
AppSec [baseline] (177.463 ms) : 0, 177463
AppSec [candidate] (176.648 ms) : 0, 176648
Remote Config [baseline] (669.237 µs) : 0, 669
Remote Config [candidate] (668.408 µs) : 0, 668
Telemetry [baseline] (8.31 ms) : 0, 8310
Telemetry [candidate] (8.291 ms) : 0, 8291
section iast
BytebuddyAgent [baseline] (837.273 ms) : 0, 837273
BytebuddyAgent [candidate] (837.56 ms) : 0, 837560
GlobalTracer [baseline] (230.391 ms) : 0, 230391
GlobalTracer [candidate] (230.592 ms) : 0, 230592
IAST [baseline] (22.951 ms) : 0, 22951
IAST [candidate] (23.008 ms) : 0, 23008
AppSec [baseline] (57.518 ms) : 0, 57518
AppSec [candidate] (57.311 ms) : 0, 57311
Remote Config [baseline] (621.325 µs) : 0, 621
Remote Config [candidate] (629.956 µs) : 0, 630
Telemetry [baseline] (8.76 ms) : 0, 8760
Telemetry [candidate] (8.791 ms) : 0, 8791
section profiling
BytebuddyAgent [baseline] (721.085 ms) : 0, 721085
BytebuddyAgent [candidate] (707.32 ms) : 0, 707320
GlobalTracer [baseline] (354.519 ms) : 0, 354519
GlobalTracer [candidate] (349.831 ms) : 0, 349831
AppSec [baseline] (56.705 ms) : 0, 56705
AppSec [candidate] (54.659 ms) : 0, 54659
Remote Config [baseline] (704.066 µs) : 0, 704
Remote Config [candidate] (672.029 µs) : 0, 672
Telemetry [baseline] (9.276 ms) : 0, 9276
Telemetry [candidate] (8.984 ms) : 0, 8984
ProfilingAgent [baseline] (98.966 ms) : 0, 98966
ProfilingAgent [candidate] (95.747 ms) : 0, 95747
Profiling [baseline] (98.991 ms) : 0, 98991
Profiling [candidate] (95.771 ms) : 0, 95771
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-21T19:01:12 2025-02-21T19:08:58
git_branch master smola/ignite-2.0-fix
git_commit_date 1740159057 1740163816
git_commit_sha 19ce7f1 cbdc13b
release_version 1.47.0-SNAPSHOT~19ce7f1a2a 1.47.0-SNAPSHOT~cbdc13b587
start_time 2025-02-21T19:00:58 2025-02-21T19:08:44
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740165337 1740165337
ci_job_id 818436298 818436298
ci_pipeline_id 56610743 56610743
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-hmquynjz-project-304-concurrent-0-m9l9jlb1 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-hmquynjz-project-304-concurrent-0-m9l9jlb1 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~cbdc13b587, baseline=1.47.0-SNAPSHOT~19ce7f1a2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (374.139 µs) : 354, 394
.   : milestone, 374,
iast (507.979 µs) : 486, 530
.   : milestone, 508,
iast_FULL (735.786 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (556.094 µs) : 535, 578
.   : milestone, 556,
iast_HARDCODED_SECRET_DISABLED (517.708 µs) : 495, 541
.   : milestone, 518,
iast_INACTIVE (463.303 µs) : 442, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (506.955 µs) : 483, 531
.   : milestone, 507,
tracing (463.969 µs) : 442, 486
.   : milestone, 464,
section candidate
no_agent (381.28 µs) : 361, 402
.   : milestone, 381,
iast (519.582 µs) : 496, 543
.   : milestone, 520,
iast_FULL (729.428 µs) : 707, 751
.   : milestone, 729,
iast_GLOBAL (556.895 µs) : 535, 579
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (511.382 µs) : 489, 534
.   : milestone, 511,
iast_INACTIVE (472.343 µs) : 451, 494
.   : milestone, 472,
iast_TELEMETRY_OFF (502.594 µs) : 479, 526
.   : milestone, 503,
tracing (464.6 µs) : 443, 486
.   : milestone, 465,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.139 µs [354.149 µs, 394.129 µs] -
iast 507.979 µs [486.351 µs, 529.607 µs] 133.84 µs (35.8%)
iast_FULL 735.786 µs [713.923 µs, 757.65 µs] 361.648 µs (96.7%)
iast_GLOBAL 556.094 µs [534.517 µs, 577.672 µs] 181.956 µs (48.6%)
iast_HARDCODED_SECRET_DISABLED 517.708 µs [494.913 µs, 540.502 µs] 143.569 µs (38.4%)
iast_INACTIVE 463.303 µs [442.083 µs, 484.523 µs] 89.164 µs (23.8%)
iast_TELEMETRY_OFF 506.955 µs [483.278 µs, 530.633 µs] 132.817 µs (35.5%)
tracing 463.969 µs [442.364 µs, 485.574 µs] 89.83 µs (24.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.28 µs [360.82 µs, 401.74 µs] -
iast 519.582 µs [496.463 µs, 542.701 µs] 138.301 µs (36.3%)
iast_FULL 729.428 µs [707.448 µs, 751.408 µs] 348.148 µs (91.3%)
iast_GLOBAL 556.895 µs [535.195 µs, 578.595 µs] 175.615 µs (46.1%)
iast_HARDCODED_SECRET_DISABLED 511.382 µs [488.808 µs, 533.957 µs] 130.102 µs (34.1%)
iast_INACTIVE 472.343 µs [450.737 µs, 493.949 µs] 91.063 µs (23.9%)
iast_TELEMETRY_OFF 502.594 µs [479.172 µs, 526.016 µs] 121.314 µs (31.8%)
tracing 464.6 µs [442.855 µs, 486.345 µs] 83.32 µs (21.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~cbdc13b587, baseline=1.47.0-SNAPSHOT~19ce7f1a2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.375 ms) : 1355, 1395
.   : milestone, 1375,
appsec (1.76 ms) : 1736, 1784
.   : milestone, 1760,
appsec_no_iast (1.784 ms) : 1760, 1808
.   : milestone, 1784,
code_origins (1.677 ms) : 1643, 1711
.   : milestone, 1677,
iast (1.496 ms) : 1472, 1520
.   : milestone, 1496,
profiling (1.503 ms) : 1480, 1527
.   : milestone, 1503,
tracing (1.509 ms) : 1485, 1534
.   : milestone, 1509,
section candidate
no_agent (1.365 ms) : 1344, 1385
.   : milestone, 1365,
appsec (1.744 ms) : 1721, 1768
.   : milestone, 1744,
appsec_no_iast (1.749 ms) : 1725, 1774
.   : milestone, 1749,
code_origins (1.684 ms) : 1652, 1717
.   : milestone, 1684,
iast (1.513 ms) : 1490, 1537
.   : milestone, 1513,
profiling (1.531 ms) : 1507, 1555
.   : milestone, 1531,
tracing (1.488 ms) : 1462, 1513
.   : milestone, 1488,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.375 ms [1.355 ms, 1.395 ms] -
appsec 1.76 ms [1.736 ms, 1.784 ms] 384.888 µs (28.0%)
appsec_no_iast 1.784 ms [1.76 ms, 1.808 ms] 408.899 µs (29.7%)
code_origins 1.677 ms [1.643 ms, 1.711 ms] 301.795 µs (21.9%)
iast 1.496 ms [1.472 ms, 1.52 ms] 120.566 µs (8.8%)
profiling 1.503 ms [1.48 ms, 1.527 ms] 128.126 µs (9.3%)
tracing 1.509 ms [1.485 ms, 1.534 ms] 134.447 µs (9.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.365 ms [1.344 ms, 1.385 ms] -
appsec 1.744 ms [1.721 ms, 1.768 ms] 379.728 µs (27.8%)
appsec_no_iast 1.749 ms [1.725 ms, 1.774 ms] 384.72 µs (28.2%)
code_origins 1.684 ms [1.652 ms, 1.717 ms] 319.628 µs (23.4%)
iast 1.513 ms [1.49 ms, 1.537 ms] 148.75 µs (10.9%)
profiling 1.531 ms [1.507 ms, 1.555 ms] 166.519 µs (12.2%)
tracing 1.488 ms [1.462 ms, 1.513 ms] 123.078 µs (9.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/ignite-2.0-fix
git_commit_date 1740159057 1740163816
git_commit_sha 19ce7f1 cbdc13b
release_version 1.47.0-SNAPSHOT~19ce7f1a2a 1.47.0-SNAPSHOT~cbdc13b587
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1740165824 1740165824
ci_job_id 818436299 818436299
ci_pipeline_id 56610743 56610743
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-64dctnlg-project-304-concurrent-2-1y0w7dpj 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-64dctnlg-project-304-concurrent-2-1y0w7dpj 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~cbdc13b587, baseline=1.47.0-SNAPSHOT~19ce7f1a2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.755 s) : 14755000, 14755000
.   : milestone, 14755000,
appsec (15.251 s) : 15251000, 15251000
.   : milestone, 15251000,
iast (19.025 s) : 19025000, 19025000
.   : milestone, 19025000,
iast_GLOBAL (17.72 s) : 17720000, 17720000
.   : milestone, 17720000,
profiling (15.187 s) : 15187000, 15187000
.   : milestone, 15187000,
tracing (15.308 s) : 15308000, 15308000
.   : milestone, 15308000,
section candidate
no_agent (15.391 s) : 15391000, 15391000
.   : milestone, 15391000,
appsec (15.172 s) : 15172000, 15172000
.   : milestone, 15172000,
iast (18.548 s) : 18548000, 18548000
.   : milestone, 18548000,
iast_GLOBAL (17.528 s) : 17528000, 17528000
.   : milestone, 17528000,
profiling (15.628 s) : 15628000, 15628000
.   : milestone, 15628000,
tracing (15.025 s) : 15025000, 15025000
.   : milestone, 15025000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.755 s [14.755 s, 14.755 s] -
appsec 15.251 s [15.251 s, 15.251 s] 496.0 ms (3.4%)
iast 19.025 s [19.025 s, 19.025 s] 4.27 s (28.9%)
iast_GLOBAL 17.72 s [17.72 s, 17.72 s] 2.965 s (20.1%)
profiling 15.187 s [15.187 s, 15.187 s] 432.0 ms (2.9%)
tracing 15.308 s [15.308 s, 15.308 s] 553.0 ms (3.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.391 s [15.391 s, 15.391 s] -
appsec 15.172 s [15.172 s, 15.172 s] -219.0 ms (-1.4%)
iast 18.548 s [18.548 s, 18.548 s] 3.157 s (20.5%)
iast_GLOBAL 17.528 s [17.528 s, 17.528 s] 2.137 s (13.9%)
profiling 15.628 s [15.628 s, 15.628 s] 237.0 ms (1.5%)
tracing 15.025 s [15.025 s, 15.025 s] -366.0 ms (-2.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~cbdc13b587, baseline=1.47.0-SNAPSHOT~19ce7f1a2a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (2.351 ms) : 2308, 2395
.   : milestone, 2351,
iast (2.096 ms) : 2041, 2151
.   : milestone, 2096,
iast_GLOBAL (2.143 ms) : 2088, 2198
.   : milestone, 2143,
profiling (2.007 ms) : 1961, 2054
.   : milestone, 2007,
tracing (1.948 ms) : 1906, 1990
.   : milestone, 1948,
section candidate
no_agent (1.465 ms) : 1454, 1477
.   : milestone, 1465,
appsec (2.346 ms) : 2302, 2389
.   : milestone, 2346,
iast (2.109 ms) : 2054, 2164
.   : milestone, 2109,
iast_GLOBAL (2.136 ms) : 2081, 2191
.   : milestone, 2136,
profiling (1.964 ms) : 1920, 2009
.   : milestone, 1964,
tracing (1.94 ms) : 1897, 1982
.   : milestone, 1940,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 2.351 ms [2.308 ms, 2.395 ms] 883.335 µs (60.2%)
iast 2.096 ms [2.041 ms, 2.151 ms] 628.118 µs (42.8%)
iast_GLOBAL 2.143 ms [2.088 ms, 2.198 ms] 674.523 µs (45.9%)
profiling 2.007 ms [1.961 ms, 2.054 ms] 539.29 µs (36.7%)
tracing 1.948 ms [1.906 ms, 1.99 ms] 479.91 µs (32.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.465 ms [1.454 ms, 1.477 ms] -
appsec 2.346 ms [2.302 ms, 2.389 ms] 880.278 µs (60.1%)
iast 2.109 ms [2.054 ms, 2.164 ms] 643.9 µs (43.9%)
iast_GLOBAL 2.136 ms [2.081 ms, 2.191 ms] 670.696 µs (45.8%)
profiling 1.964 ms [1.92 ms, 2.009 ms] 499.071 µs (34.1%)
tracing 1.94 ms [1.897 ms, 1.982 ms] 474.473 µs (32.4%)

@smola smola force-pushed the smola/ignite-2.0-fix branch from 4d07f83 to cbdc13b Compare February 21, 2025 18:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer left review comments

@datadog-datadog-prod-us1 datadog-datadog-prod-us1[bot] datadog-datadog-prod-us1[bot] left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
comp: testing Testing inst: others All other instrumentations tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@smola @PerfectSlayer