Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

upgrade(ci): Add local registry for OCI E2E testing #6912

Closed
wants to merge 3 commits into from
Closed

upgrade(ci): Add local registry for OCI E2E testing #6912

wants to merge 3 commits into from

Conversation

BaptisteFoy
Copy link
Contributor

@BaptisteFoy BaptisteFoy commented Apr 15, 2024 •
edited

What Does This Do

Adds the INSTALLER_AUTO_INJECTION test to the pipeline

Motivation

Testing this tracer with the auto inject + installer setup

Additional Notes

N/A

@BaptisteFoy BaptisteFoy force-pushed the baptiste.foy/FA/internal-registry branch 5 times, most recently from fcea334 to 81146a5 Compare April 15, 2024 13:12
@pr-commenter
Copy link

pr-commenter bot commented Apr 15, 2024 •
edited

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master baptiste.foy/FA/internal-registry
git_commit_date 1714138507 1714145750
git_commit_sha a481d0b ab69793
release_version 1.34.0-SNAPSHOT~a481d0b8c2 1.34.0-SNAPSHOT~ab69793fbf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1714148146 1714148146
ci_job_id 498513971 498513971
ci_pipeline_id 33031600 33031600
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.34.0-SNAPSHOT~ab69793fbf, baseline=1.34.0-SNAPSHOT~a481d0b8c2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1082536
Total [baseline] (8.573 s) : 0, 8572999
Agent [candidate] (1.077 s) : 0, 1076738
Total [candidate] (8.554 s) : 0, 8554160
section iast
Agent [baseline] (1.198 s) : 0, 1198456
Total [baseline] (8.991 s) : 0, 8990851
Agent [candidate] (1.198 s) : 0, 1198050
Total [candidate] (9.006 s) : 0, 9005944
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.199 s) : 0, 1198680
Total [baseline] (8.975 s) : 0, 8974805
Agent [candidate] (1.198 s) : 0, 1198113
Total [candidate] (8.972 s) : 0, 8972266
section iast_TELEMETRY_OFF
Agent [baseline] (1.209 s) : 0, 1209420
Total [baseline] (9.01 s) : 0, 9010007
Agent [candidate] (1.197 s) : 0, 1196620
Total [candidate] (8.995 s) : 0, 8994966
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.198 s 115.92 ms (10.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.199 s 116.144 ms (10.7%)
Agent iast_TELEMETRY_OFF 1.209 s 126.884 ms (11.7%)
Total tracing 8.573 s -
Total iast 8.991 s 417.852 ms (4.9%)
Total iast_HARDCODED_SECRET_DISABLED 8.975 s 401.806 ms (4.7%)
Total iast_TELEMETRY_OFF 9.01 s 437.008 ms (5.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent iast 1.198 s 121.312 ms (11.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.198 s 121.375 ms (11.3%)
Agent iast_TELEMETRY_OFF 1.197 s 119.881 ms (11.1%)
Total tracing 8.554 s -
Total iast 9.006 s 451.783 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.972 s 418.106 ms (4.9%)
Total iast_TELEMETRY_OFF 8.995 s 440.806 ms (5.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.34.0-SNAPSHOT~ab69793fbf, baseline=1.34.0-SNAPSHOT~a481d0b8c2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (678.634 ms) : 0, 678634
BytebuddyAgent [candidate] (674.66 ms) : 0, 674660
GlobalTracer [baseline] (311.091 ms) : 0, 311091
GlobalTracer [candidate] (309.947 ms) : 0, 309947
AppSec [baseline] (49.79 ms) : 0, 49790
AppSec [candidate] (49.496 ms) : 0, 49496
Remote Config [baseline] (668.066 µs) : 0, 668
Remote Config [candidate] (658.545 µs) : 0, 659
Telemetry [baseline] (7.589 ms) : 0, 7589
Telemetry [candidate] (7.563 ms) : 0, 7563
section iast
BytebuddyAgent [baseline] (794.024 ms) : 0, 794024
BytebuddyAgent [candidate] (793.817 ms) : 0, 793817
GlobalTracer [baseline] (287.847 ms) : 0, 287847
GlobalTracer [candidate] (288.39 ms) : 0, 288390
AppSec [baseline] (50.861 ms) : 0, 50861
AppSec [candidate] (50.465 ms) : 0, 50465
IAST [baseline] (23.337 ms) : 0, 23337
IAST [candidate] (22.094 ms) : 0, 22094
Remote Config [baseline] (563.125 µs) : 0, 563
Remote Config [candidate] (2.128 ms) : 0, 2128
Telemetry [baseline] (7.357 ms) : 0, 7357
Telemetry [candidate] (6.751 ms) : 0, 6751
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (793.317 ms) : 0, 793317
BytebuddyAgent [candidate] (793.552 ms) : 0, 793552
GlobalTracer [baseline] (288.448 ms) : 0, 288448
GlobalTracer [candidate] (287.664 ms) : 0, 287664
AppSec [baseline] (51.289 ms) : 0, 51289
AppSec [candidate] (47.821 ms) : 0, 47821
IAST [baseline] (21.758 ms) : 0, 21758
IAST [candidate] (25.048 ms) : 0, 25048
Remote Config [baseline] (585.918 µs) : 0, 586
Remote Config [candidate] (578.573 µs) : 0, 579
Telemetry [baseline] (8.885 ms) : 0, 8885
Telemetry [candidate] (8.876 ms) : 0, 8876
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (801.724 ms) : 0, 801724
BytebuddyAgent [candidate] (792.07 ms) : 0, 792070
GlobalTracer [baseline] (291.458 ms) : 0, 291458
GlobalTracer [candidate] (288.448 ms) : 0, 288448
AppSec [baseline] (51.186 ms) : 0, 51186
AppSec [candidate] (49.069 ms) : 0, 49069
IAST [baseline] (22.231 ms) : 0, 22231
IAST [candidate] (23.207 ms) : 0, 23207
Remote Config [baseline] (603.946 µs) : 0, 604
Remote Config [candidate] (599.409 µs) : 0, 599
Telemetry [baseline] (7.395 ms) : 0, 7395
Telemetry [candidate] (8.834 ms) : 0, 8834
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.34.0-SNAPSHOT~ab69793fbf, baseline=1.34.0-SNAPSHOT~a481d0b8c2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1080234
Total [baseline] (10.413 s) : 0, 10412821
Agent [candidate] (1.076 s) : 0, 1076047
Total [candidate] (10.323 s) : 0, 10323247
section appsec
Agent [baseline] (1.186 s) : 0, 1186030
Total [baseline] (10.501 s) : 0, 10501469
Agent [candidate] (1.192 s) : 0, 1192245
Total [candidate] (10.469 s) : 0, 10469144
section iast
Agent [baseline] (1.201 s) : 0, 1200626
Total [baseline] (10.774 s) : 0, 10773833
Agent [candidate] (1.2 s) : 0, 1199903
Total [candidate] (10.659 s) : 0, 10659034
section profiling
Agent [baseline] (1.27 s) : 0, 1269509
Total [baseline] (10.615 s) : 0, 10614601
Agent [candidate] (1.265 s) : 0, 1264994
Total [candidate] (10.616 s) : 0, 10615974
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent appsec 1.186 s 105.796 ms (9.8%)
Agent iast 1.201 s 120.392 ms (11.1%)
Agent profiling 1.27 s 189.275 ms (17.5%)
Total tracing 10.413 s -
Total appsec 10.501 s 88.648 ms (0.9%)
Total iast 10.774 s 361.012 ms (3.5%)
Total profiling 10.615 s 201.779 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent appsec 1.192 s 116.199 ms (10.8%)
Agent iast 1.2 s 123.856 ms (11.5%)
Agent profiling 1.265 s 188.947 ms (17.6%)
Total tracing 10.323 s -
Total appsec 10.469 s 145.897 ms (1.4%)
Total iast 10.659 s 335.786 ms (3.3%)
Total profiling 10.616 s 292.726 ms (2.8%) 
gantt
    title petclinic - break down per module: candidate=1.34.0-SNAPSHOT~ab69793fbf, baseline=1.34.0-SNAPSHOT~a481d0b8c2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (676.392 ms) : 0, 676392
BytebuddyAgent [candidate] (673.736 ms) : 0, 673736
GlobalTracer [baseline] (311.329 ms) : 0, 311329
GlobalTracer [candidate] (310.141 ms) : 0, 310141
AppSec [baseline] (49.731 ms) : 0, 49731
AppSec [candidate] (49.526 ms) : 0, 49526
Remote Config [baseline] (651.85 µs) : 0, 652
Remote Config [candidate] (655.039 µs) : 0, 655
Telemetry [baseline] (7.601 ms) : 0, 7601
Telemetry [candidate] (7.616 ms) : 0, 7616
section appsec
BytebuddyAgent [baseline] (694.422 ms) : 0, 694422
BytebuddyAgent [candidate] (697.745 ms) : 0, 697745
GlobalTracer [baseline] (290.922 ms) : 0, 290922
GlobalTracer [candidate] (292.36 ms) : 0, 292360
AppSec [baseline] (148.946 ms) : 0, 148946
AppSec [candidate] (149.52 ms) : 0, 149520
IAST [baseline] (19.254 ms) : 0, 19254
IAST [candidate] (19.485 ms) : 0, 19485
Remote Config [baseline] (615.008 µs) : 0, 615
Remote Config [candidate] (619.663 µs) : 0, 620
Telemetry [baseline] (7.189 ms) : 0, 7189
Telemetry [candidate] (7.799 ms) : 0, 7799
section iast
BytebuddyAgent [baseline] (795.044 ms) : 0, 795044
BytebuddyAgent [candidate] (794.463 ms) : 0, 794463
GlobalTracer [baseline] (289.085 ms) : 0, 289085
GlobalTracer [candidate] (288.525 ms) : 0, 288525
AppSec [baseline] (50.867 ms) : 0, 50867
AppSec [candidate] (48.754 ms) : 0, 48754
IAST [baseline] (23.355 ms) : 0, 23355
IAST [candidate] (25.944 ms) : 0, 25944
Remote Config [baseline] (568.314 µs) : 0, 568
Remote Config [candidate] (566.415 µs) : 0, 566
Telemetry [baseline] (7.366 ms) : 0, 7366
Telemetry [candidate] (7.353 ms) : 0, 7353
section profiling
BytebuddyAgent [baseline] (678.465 ms) : 0, 678465
BytebuddyAgent [candidate] (674.789 ms) : 0, 674789
GlobalTracer [baseline] (380.521 ms) : 0, 380521
GlobalTracer [candidate] (379.441 ms) : 0, 379441
AppSec [baseline] (50.082 ms) : 0, 50082
AppSec [candidate] (49.893 ms) : 0, 49893
Remote Config [baseline] (716.767 µs) : 0, 717
Remote Config [candidate] (702.186 µs) : 0, 702
Telemetry [baseline] (7.483 ms) : 0, 7483
Telemetry [candidate] (7.437 ms) : 0, 7437
ProfilingAgent [baseline] (95.858 ms) : 0, 95858
ProfilingAgent [candidate] (96.448 ms) : 0, 96448
Profiling [baseline] (95.882 ms) : 0, 95882
Profiling [candidate] (96.472 ms) : 0, 96472

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-04-26T15:46:34 2024-04-26T15:53:23
git_branch master baptiste.foy/FA/internal-registry
git_commit_date 1714138507 1714145750
git_commit_sha a481d0b ab69793
release_version 1.34.0-SNAPSHOT~a481d0b8c2 1.34.0-SNAPSHOT~ab69793fbf
start_time 2024-04-26T15:46:21 2024-04-26T15:53:10
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1714147147 1714147147
ci_job_id 498513972 498513972
ci_pipeline_id 33031600 33031600
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 16 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling better
[-91.266µs; -37.434µs] or [-5.886%; -2.414%]		 unstable
[-485.544op/s; +713.464op/s] or [-16.387%; +24.079%]		 1.486ms 3076.923op/s 1.551ms 2962.963op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~ab69793fbf, baseline=1.34.0-SNAPSHOT~a481d0b8c2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.356 ms) : 1335, 1376
.   : milestone, 1356,
appsec (1.733 ms) : 1710, 1757
.   : milestone, 1733,
appsec_no_iast (1.717 ms) : 1693, 1742
.   : milestone, 1717,
iast (1.504 ms) : 1482, 1526
.   : milestone, 1504,
profiling (1.551 ms) : 1526, 1576
.   : milestone, 1551,
tracing (1.477 ms) : 1451, 1503
.   : milestone, 1477,
section candidate
no_agent (1.34 ms) : 1320, 1360
.   : milestone, 1340,
appsec (1.722 ms) : 1698, 1746
.   : milestone, 1722,
appsec_no_iast (1.735 ms) : 1711, 1759
.   : milestone, 1735,
iast (1.473 ms) : 1450, 1496
.   : milestone, 1473,
profiling (1.486 ms) : 1461, 1511
.   : milestone, 1486,
tracing (1.472 ms) : 1448, 1497
.   : milestone, 1472,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.356 ms [1.335 ms, 1.376 ms] -
appsec 1.733 ms [1.71 ms, 1.757 ms] 377.634 µs (27.9%)
appsec_no_iast 1.717 ms [1.693 ms, 1.742 ms] 361.582 µs (26.7%)
iast 1.504 ms [1.482 ms, 1.526 ms] 148.03 µs (10.9%)
profiling 1.551 ms [1.526 ms, 1.576 ms] 194.963 µs (14.4%)
tracing 1.477 ms [1.451 ms, 1.503 ms] 121.193 µs (8.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.34 ms [1.32 ms, 1.36 ms] -
appsec 1.722 ms [1.698 ms, 1.746 ms] 381.91 µs (28.5%)
appsec_no_iast 1.735 ms [1.711 ms, 1.759 ms] 395.033 µs (29.5%)
iast 1.473 ms [1.45 ms, 1.496 ms] 133.27 µs (9.9%)
profiling 1.486 ms [1.461 ms, 1.511 ms] 146.196 µs (10.9%)
tracing 1.472 ms [1.448 ms, 1.497 ms] 132.318 µs (9.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~ab69793fbf, baseline=1.34.0-SNAPSHOT~a481d0b8c2
    dateFormat X
    axisFormat %s
section baseline
no_agent (363.366 µs) : 344, 383
.   : milestone, 363,
iast (469.619 µs) : 449, 491
.   : milestone, 470,
iast_FULL (540.347 µs) : 519, 562
.   : milestone, 540,
iast_GLOBAL (493.549 µs) : 472, 515
.   : milestone, 494,
iast_HARDCODED_SECRET_DISABLED (471.684 µs) : 450, 493
.   : milestone, 472,
iast_INACTIVE (449.579 µs) : 429, 470
.   : milestone, 450,
iast_TELEMETRY_OFF (464.391 µs) : 443, 485
.   : milestone, 464,
tracing (441.054 µs) : 421, 461
.   : milestone, 441,
section candidate
no_agent (364.884 µs) : 345, 385
.   : milestone, 365,
iast (471.656 µs) : 450, 493
.   : milestone, 472,
iast_FULL (536.242 µs) : 515, 558
.   : milestone, 536,
iast_GLOBAL (490.605 µs) : 469, 512
.   : milestone, 491,
iast_HARDCODED_SECRET_DISABLED (475.095 µs) : 454, 496
.   : milestone, 475,
iast_INACTIVE (440.436 µs) : 420, 461
.   : milestone, 440,
iast_TELEMETRY_OFF (467.894 µs) : 447, 489
.   : milestone, 468,
tracing (441.866 µs) : 421, 463
.   : milestone, 442,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 363.366 µs [343.88 µs, 382.851 µs] -
iast 469.619 µs [448.55 µs, 490.687 µs] 106.253 µs (29.2%)
iast_FULL 540.347 µs [518.548 µs, 562.145 µs] 176.981 µs (48.7%)
iast_GLOBAL 493.549 µs [472.177 µs, 514.921 µs] 130.183 µs (35.8%)
iast_HARDCODED_SECRET_DISABLED 471.684 µs [450.452 µs, 492.915 µs] 108.318 µs (29.8%)
iast_INACTIVE 449.579 µs [428.772 µs, 470.386 µs] 86.214 µs (23.7%)
iast_TELEMETRY_OFF 464.391 µs [443.483 µs, 485.299 µs] 101.025 µs (27.8%)
tracing 441.054 µs [420.659 µs, 461.45 µs] 77.688 µs (21.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.884 µs [345.258 µs, 384.51 µs] -
iast 471.656 µs [450.433 µs, 492.879 µs] 106.772 µs (29.3%)
iast_FULL 536.242 µs [514.907 µs, 557.578 µs] 171.358 µs (47.0%)
iast_GLOBAL 490.605 µs [469.332 µs, 511.878 µs] 125.721 µs (34.5%)
iast_HARDCODED_SECRET_DISABLED 475.095 µs [453.891 µs, 496.298 µs] 110.211 µs (30.2%)
iast_INACTIVE 440.436 µs [420.047 µs, 460.825 µs] 75.552 µs (20.7%)
iast_TELEMETRY_OFF 467.894 µs [446.839 µs, 488.95 µs] 103.011 µs (28.2%)
tracing 441.866 µs [421.187 µs, 462.545 µs] 76.982 µs (21.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master baptiste.foy/FA/internal-registry
git_commit_date 1714138507 1714145750
git_commit_sha a481d0b ab69793
release_version 1.34.0-SNAPSHOT~a481d0b8c2 1.34.0-SNAPSHOT~ab69793fbf
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1714147650 1714147650
ci_job_id 498513974 498513974
ci_pipeline_id 33031600 33031600
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~ab69793fbf, baseline=1.34.0-SNAPSHOT~a481d0b8c2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.399 s) : 15399000, 15399000
.   : milestone, 15399000,
appsec (15.026 s) : 15026000, 15026000
.   : milestone, 15026000,
iast (18.657 s) : 18657000, 18657000
.   : milestone, 18657000,
iast_GLOBAL (18.146 s) : 18146000, 18146000
.   : milestone, 18146000,
profiling (15.296 s) : 15296000, 15296000
.   : milestone, 15296000,
tracing (14.983 s) : 14983000, 14983000
.   : milestone, 14983000,
section candidate
no_agent (15.454 s) : 15454000, 15454000
.   : milestone, 15454000,
appsec (15.336 s) : 15336000, 15336000
.   : milestone, 15336000,
iast (18.588 s) : 18588000, 18588000
.   : milestone, 18588000,
iast_GLOBAL (17.852 s) : 17852000, 17852000
.   : milestone, 17852000,
profiling (15.221 s) : 15221000, 15221000
.   : milestone, 15221000,
tracing (14.776 s) : 14776000, 14776000
.   : milestone, 14776000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.399 s [15.399 s, 15.399 s] -
appsec 15.026 s [15.026 s, 15.026 s] -373.0 ms (-2.4%)
iast 18.657 s [18.657 s, 18.657 s] 3.258 s (21.2%)
iast_GLOBAL 18.146 s [18.146 s, 18.146 s] 2.747 s (17.8%)
profiling 15.296 s [15.296 s, 15.296 s] -103.0 ms (-0.7%)
tracing 14.983 s [14.983 s, 14.983 s] -416.0 ms (-2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.454 s [15.454 s, 15.454 s] -
appsec 15.336 s [15.336 s, 15.336 s] -118.0 ms (-0.8%)
iast 18.588 s [18.588 s, 18.588 s] 3.134 s (20.3%)
iast_GLOBAL 17.852 s [17.852 s, 17.852 s] 2.398 s (15.5%)
profiling 15.221 s [15.221 s, 15.221 s] -233.0 ms (-1.5%)
tracing 14.776 s [14.776 s, 14.776 s] -678.0 ms (-4.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~ab69793fbf, baseline=1.34.0-SNAPSHOT~a481d0b8c2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.463 ms) : 1452, 1474
.   : milestone, 1463,
appsec (2.2 ms) : 2167, 2234
.   : milestone, 2200,
iast (1.886 ms) : 1850, 1921
.   : milestone, 1886,
iast_GLOBAL (1.914 ms) : 1880, 1949
.   : milestone, 1914,
profiling (1.836 ms) : 1804, 1869
.   : milestone, 1836,
tracing (1.828 ms) : 1796, 1860
.   : milestone, 1828,
section candidate
no_agent (1.46 ms) : 1448, 1471
.   : milestone, 1460,
appsec (2.184 ms) : 2151, 2217
.   : milestone, 2184,
iast (1.869 ms) : 1835, 1904
.   : milestone, 1869,
iast_GLOBAL (1.91 ms) : 1876, 1944
.   : milestone, 1910,
profiling (1.832 ms) : 1799, 1865
.   : milestone, 1832,
tracing (1.821 ms) : 1790, 1852
.   : milestone, 1821,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.452 ms, 1.474 ms] -
appsec 2.2 ms [2.167 ms, 2.234 ms] 737.447 µs (50.4%)
iast 1.886 ms [1.85 ms, 1.921 ms] 422.863 µs (28.9%)
iast_GLOBAL 1.914 ms [1.88 ms, 1.949 ms] 451.171 µs (30.8%)
profiling 1.836 ms [1.804 ms, 1.869 ms] 373.481 µs (25.5%)
tracing 1.828 ms [1.796 ms, 1.86 ms] 365.332 µs (25.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.46 ms [1.448 ms, 1.471 ms] -
appsec 2.184 ms [2.151 ms, 2.217 ms] 724.24 µs (49.6%)
iast 1.869 ms [1.835 ms, 1.904 ms] 409.665 µs (28.1%)
iast_GLOBAL 1.91 ms [1.876 ms, 1.944 ms] 450.151 µs (30.8%)
profiling 1.832 ms [1.799 ms, 1.865 ms] 372.049 µs (25.5%)
tracing 1.821 ms [1.79 ms, 1.852 ms] 361.271 µs (24.8%)

@BaptisteFoy BaptisteFoy force-pushed the baptiste.foy/FA/internal-registry branch 9 times, most recently from e3bd3dd to 3ccadbf Compare April 24, 2024 12:58
@BaptisteFoy BaptisteFoy force-pushed the baptiste.foy/FA/internal-registry branch from 3ccadbf to 498572a Compare April 24, 2024 13:46
@BaptisteFoy BaptisteFoy mentioned this pull request Apr 24, 2024
Merged
9 tasks
@BaptisteFoy BaptisteFoy force-pushed the baptiste.foy/FA/internal-registry branch from 40e8cb4 to ab69793 Compare April 26, 2024 15:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@BaptisteFoy