Skip to content

Make Code Origin for Spans default on#9873

Merged
jpbempel merged 2 commits intomasterfrom
jpbempel/code-origin-default-on
Nov 12, 2025
Merged

Make Code Origin for Spans default on#9873
jpbempel merged 2 commits intomasterfrom
jpbempel/code-origin-default-on

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Oct 28, 2025 •
edited
Loading

What Does This Do

by default Code Origin will be started

Motivation

Additional Notes

This feature can be disabled by setting DD_CODE_ORIGIN_FOR_SPANS_ENABLED=false

Contributor Checklist

Jira ticket: DEBUG-4173

@jpbempel jpbempel requested a review from a team as a code owner October 28, 2025 16:57
@jpbempel jpbempel requested a review from mcculls October 28, 2025 16:57
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Oct 28, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Oct 28, 2025 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added the type: enhancement Enhancements and improvements label Oct 28, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Oct 28, 2025 •
edited by datadog-official bot
Loading

🎯 Code Coverage
• Patch Coverage: 0.00%
• Total Coverage: 59.47% (-0.14%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 7beade4 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 28, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
release_version 1.56.0-SNAPSHOT~5db793a092 1.56.0-SNAPSHOT~7beade4bca
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762931182 1762931182
ci_job_id 1229112899 1229112899
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-d7o9jpor 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-d7o9jpor 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 10 performance improvements and 7 performance regressions! Performance is the same for 33 metrics, 15 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent worse
[+226.292ms; +294.998ms] or [+2.438%; +3.179%]		 9.542s 9.281s
scenario:startup:insecure-bank:iast:Agent.start worse
[+53.167ms; +71.583ms] or [+4.499%; +6.057%]		 1.244s 1.182s
scenario:startup:insecure-bank:iast:Remote Config better
[-64.134µs; -28.490µs] or [-10.619%; -4.717%]		 557.645µs 603.957µs
scenario:startup:insecure-bank:iast:Flare Poller better
[-691.147µs; -494.521µs] or [-16.597%; -11.875%]		 3.572ms 4.164ms
scenario:startup:insecure-bank:tracing:Agent.start worse
[+46.436ms; +53.352ms] or [+4.417%; +5.075%]		 1.101s 1.051s
scenario:startup:insecure-bank:tracing:Remote Config better
[-74.785µs; -43.939µs] or [-10.478%; -6.156%]		 654.381µs 713.743µs
scenario:startup:petclinic:appsec:Agent.start worse
[+32.858ms; +79.333ms] or [+2.671%; +6.448%]		 1.286s 1.230s
scenario:startup:petclinic:appsec:Flare Poller better
[-432.288µs; -167.454µs] or [-10.618%; -4.113%]		 3.771ms 4.071ms
scenario:startup:petclinic:iast:Agent.start worse
[+56.573ms; +66.467ms] or [+4.793%; +5.631%]		 1.242s 1.180s
scenario:startup:petclinic:iast:Remote Config better
[-75.424µs; -27.753µs] or [-12.393%; -4.560%]		 557.032µs 608.620µs
scenario:startup:petclinic:iast:Flare Poller better
[-642.606µs; -404.372µs] or [-15.551%; -9.786%]		 3.609ms 4.132ms
scenario:startup:petclinic:profiling:Agent.start worse
[+30.531ms; +62.965ms] or [+2.559%; +5.278%]		 1.240s 1.193s
scenario:startup:petclinic:profiling:ProfilingAgent better
[-15.308ms; -13.692ms] or [-13.769%; -12.315%]		 96.682ms 111.182ms
scenario:startup:petclinic:profiling:Flare Poller better
[-459.601µs; -215.211µs] or [-11.111%; -5.203%]		 3.799ms 4.136ms
scenario:startup:petclinic:profiling:Profiling better
[-15.411ms; -13.795ms] or [-13.777%; -12.332%]		 97.259ms 111.862ms
scenario:startup:petclinic:tracing:Agent.start worse
[+37.702ms; +66.572ms] or [+3.583%; +6.326%]		 1.104s 1.052s
scenario:startup:petclinic:tracing:Remote Config better
[-99.235µs; -41.139µs] or [-13.572%; -5.626%]		 660.981µs 731.168µs
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051195
Total [baseline] (8.651 s) : 0, 8651309
Agent [candidate] (1.101 s) : 0, 1101089
Total [candidate] (8.813 s) : 0, 8812775
section iast
Agent [baseline] (1.182 s) : 0, 1181859
Total [baseline] (9.281 s) : 0, 9280871
Agent [candidate] (1.244 s) : 0, 1244234
Total [candidate] (9.542 s) : 0, 9541516
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.182 s 130.663 ms (12.4%)
Total tracing 8.651 s -
Total iast 9.281 s 629.561 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.101 s -
Agent iast 1.244 s 143.145 ms (13.0%)
Total tracing 8.813 s -
Total iast 9.542 s 728.74 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.473 ms) : 0, 1473
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (707.259 ms) : 0, 707259
BytebuddyAgent [candidate] (705.995 ms) : 0, 705995
GlobalTracer [baseline] (246.729 ms) : 0, 246729
GlobalTracer [candidate] (245.094 ms) : 0, 245094
AppSec [baseline] (32.482 ms) : 0, 32482
AppSec [candidate] (32.27 ms) : 0, 32270
Debugger [baseline] (6.376 ms) : 0, 6376
Debugger [candidate] (68.466 ms) : 0, 68466
Remote Config [baseline] (713.743 µs) : 0, 714
Remote Config [candidate] (654.381 µs) : 0, 654
Telemetry [baseline] (14.814 ms) : 0, 14814
Telemetry [candidate] (8.728 ms) : 0, 8728
Flare Poller [baseline] (6.549 ms) : 0, 6549
Flare Poller [candidate] (3.696 ms) : 0, 3696
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.481 ms) : 0, 1481
BytebuddyAgent [baseline] (829.416 ms) : 0, 829416
BytebuddyAgent [candidate] (833.306 ms) : 0, 833306
GlobalTracer [baseline] (235.159 ms) : 0, 235159
GlobalTracer [candidate] (235.348 ms) : 0, 235348
AppSec [baseline] (29.85 ms) : 0, 29850
AppSec [candidate] (31.517 ms) : 0, 31517
Debugger [baseline] (5.999 ms) : 0, 5999
Debugger [candidate] (65.261 ms) : 0, 65261
Remote Config [baseline] (603.957 µs) : 0, 604
Remote Config [candidate] (557.645 µs) : 0, 558
Telemetry [baseline] (8.578 ms) : 0, 8578
Telemetry [candidate] (8.195 ms) : 0, 8195
Flare Poller [baseline] (4.164 ms) : 0, 4164
Flare Poller [candidate] (3.572 ms) : 0, 3572
IAST [baseline] (31.784 ms) : 0, 31784
IAST [candidate] (30.075 ms) : 0, 30075
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052322
Total [baseline] (10.868 s) : 0, 10867661
Agent [candidate] (1.104 s) : 0, 1104459
Total [candidate] (10.755 s) : 0, 10755298
section appsec
Agent [baseline] (1.23 s) : 0, 1230362
Total [baseline] (10.962 s) : 0, 10962023
Agent [candidate] (1.286 s) : 0, 1286458
Total [candidate] (11.119 s) : 0, 11118581
section iast
Agent [baseline] (1.18 s) : 0, 1180337
Total [baseline] (11.138 s) : 0, 11138098
Agent [candidate] (1.242 s) : 0, 1241856
Total [candidate] (11.18 s) : 0, 11179911
section profiling
Agent [baseline] (1.193 s) : 0, 1193051
Total [baseline] (10.96 s) : 0, 10960208
Agent [candidate] (1.24 s) : 0, 1239799
Total [candidate] (11.121 s) : 0, 11120552
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.23 s 178.04 ms (16.9%)
Agent iast 1.18 s 128.015 ms (12.2%)
Agent profiling 1.193 s 140.729 ms (13.4%)
Total tracing 10.868 s -
Total appsec 10.962 s 94.363 ms (0.9%)
Total iast 11.138 s 270.437 ms (2.5%)
Total profiling 10.96 s 92.547 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.104 s -
Agent appsec 1.286 s 181.999 ms (16.5%)
Agent iast 1.242 s 137.398 ms (12.4%)
Agent profiling 1.24 s 135.34 ms (12.3%)
Total tracing 10.755 s -
Total appsec 11.119 s 363.283 ms (3.4%)
Total iast 11.18 s 424.612 ms (3.9%)
Total profiling 11.121 s 365.254 ms (3.4%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.482 ms) : 0, 1482
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (708.571 ms) : 0, 708571
BytebuddyAgent [candidate] (707.533 ms) : 0, 707533
GlobalTracer [baseline] (246.875 ms) : 0, 246875
GlobalTracer [candidate] (245.964 ms) : 0, 245964
AppSec [baseline] (32.605 ms) : 0, 32605
AppSec [candidate] (32.365 ms) : 0, 32365
Debugger [baseline] (6.442 ms) : 0, 6442
Debugger [candidate] (69.374 ms) : 0, 69374
Remote Config [baseline] (731.168 µs) : 0, 731
Remote Config [candidate] (660.981 µs) : 0, 661
Telemetry [baseline] (11.693 ms) : 0, 11693
Telemetry [candidate] (8.609 ms) : 0, 8609
Flare Poller [baseline] (9.018 ms) : 0, 9018
Flare Poller [candidate] (3.676 ms) : 0, 3676
section appsec
crashtracking [baseline] (1.483 ms) : 0, 1483
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (734.154 ms) : 0, 734154
BytebuddyAgent [candidate] (735.318 ms) : 0, 735318
GlobalTracer [baseline] (239.15 ms) : 0, 239150
GlobalTracer [candidate] (239.278 ms) : 0, 239278
AppSec [baseline] (175.97 ms) : 0, 175970
AppSec [candidate] (175.603 ms) : 0, 175603
Debugger [baseline] (6.037 ms) : 0, 6037
Debugger [candidate] (61.154 ms) : 0, 61154
Remote Config [baseline] (659.736 µs) : 0, 660
Remote Config [candidate] (642.19 µs) : 0, 642
Telemetry [baseline] (8.66 ms) : 0, 8660
Telemetry [candidate] (9.07 ms) : 0, 9070
Flare Poller [baseline] (4.071 ms) : 0, 4071
Flare Poller [candidate] (3.771 ms) : 0, 3771
IAST [baseline] (25.107 ms) : 0, 25107
IAST [candidate] (25.157 ms) : 0, 25157
section iast
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (828.582 ms) : 0, 828582
BytebuddyAgent [candidate] (829.272 ms) : 0, 829272
GlobalTracer [baseline] (234.899 ms) : 0, 234899
GlobalTracer [candidate] (235.495 ms) : 0, 235495
AppSec [baseline] (30.587 ms) : 0, 30587
AppSec [candidate] (30.831 ms) : 0, 30831
Debugger [baseline] (6.008 ms) : 0, 6008
Debugger [candidate] (66.695 ms) : 0, 66695
Remote Config [baseline] (608.62 µs) : 0, 609
Remote Config [candidate] (557.032 µs) : 0, 557
Telemetry [baseline] (8.475 ms) : 0, 8475
Telemetry [candidate] (8.268 ms) : 0, 8268
Flare Poller [baseline] (4.132 ms) : 0, 4132
Flare Poller [candidate] (3.609 ms) : 0, 3609
IAST [baseline] (30.791 ms) : 0, 30791
IAST [candidate] (30.926 ms) : 0, 30926
section profiling
ProfilingAgent [baseline] (111.182 ms) : 0, 111182
ProfilingAgent [candidate] (96.682 ms) : 0, 96682
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (728.387 ms) : 0, 728387
BytebuddyAgent [candidate] (734.809 ms) : 0, 734809
GlobalTracer [baseline] (222.099 ms) : 0, 222099
GlobalTracer [candidate] (223.446 ms) : 0, 223446
AppSec [baseline] (32.232 ms) : 0, 32232
AppSec [candidate] (32.566 ms) : 0, 32566
Debugger [baseline] (7.556 ms) : 0, 7556
Debugger [candidate] (68.291 ms) : 0, 68291
Remote Config [baseline] (687.592 µs) : 0, 688
Remote Config [candidate] (651.212 µs) : 0, 651
Telemetry [baseline] (15.59 ms) : 0, 15590
Telemetry [candidate] (8.024 ms) : 0, 8024
Flare Poller [baseline] (4.136 ms) : 0, 4136
Flare Poller [candidate] (3.799 ms) : 0, 3799
Profiling [baseline] (111.862 ms) : 0, 111862
Profiling [candidate] (97.259 ms) : 0, 97259
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
release_version 1.56.0-SNAPSHOT~5db793a092 1.56.0-SNAPSHOT~7beade4bca
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762931671 1762931671
ci_job_id 1229112900 1229112900
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-jg8aqu4j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-jg8aqu4j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+73.532µs; +204.607µs] or [+2.622%; +7.297%]		 unsure
[+10.139µs; +428.894µs] or [+0.129%; +5.458%]		 unstable
[-225.915op/s; +81.915op/s] or [-17.368%; +6.297%]		 2.943ms 8.077ms 1228.781op/s 2.804ms 7.858ms 1300.781op/s
scenario:load:insecure-bank:iast_FULL:high_load unstable
[+182.408µs; +682.997µs] or [+3.763%; +14.090%]		 worse
[+344.751µs; +1453.112µs] or [+2.922%; +12.315%]		 unstable
[-167.927op/s; +23.177op/s] or [-19.865%; +2.742%]		 5.280ms 12.699ms 772.969op/s 4.847ms 11.800ms 845.344op/s
scenario:load:petclinic:appsec:high_load better
[-1.953ms; -0.983ms] or [-9.898%; -4.982%]		 better
[-2.552ms; -0.960ms] or [-8.032%; -3.021%]		 unstable
[-10.342op/s; +39.592op/s] or [-4.411%; +16.888%]		 18.265ms 30.015ms 249.062op/s 19.733ms 31.771ms 234.438op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.414 ms) : 19212, 19615
.   : milestone, 19414,
appsec (19.911 ms) : 19704, 20117
.   : milestone, 19911,
code_origins (17.526 ms) : 17354, 17699
.   : milestone, 17526,
iast (17.996 ms) : 17816, 18176
.   : milestone, 17996,
profiling (18.527 ms) : 18343, 18711
.   : milestone, 18527,
tracing (17.895 ms) : 17717, 18073
.   : milestone, 17895,
section candidate
no_agent (17.995 ms) : 17815, 18176
.   : milestone, 17995,
appsec (18.736 ms) : 18547, 18926
.   : milestone, 18736,
code_origins (17.819 ms) : 17641, 17997
.   : milestone, 17819,
iast (17.757 ms) : 17578, 17937
.   : milestone, 17757,
profiling (18.464 ms) : 18275, 18652
.   : milestone, 18464,
tracing (18.01 ms) : 17828, 18193
.   : milestone, 18010,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.414 ms [19.212 ms, 19.615 ms] -
appsec 19.911 ms [19.704 ms, 20.117 ms] 497.186 µs (2.6%)
code_origins 17.526 ms [17.354 ms, 17.699 ms] -1.887 ms (-9.7%)
iast 17.996 ms [17.816 ms, 18.176 ms] -1.418 ms (-7.3%)
profiling 18.527 ms [18.343 ms, 18.711 ms] -886.573 µs (-4.6%)
tracing 17.895 ms [17.717 ms, 18.073 ms] -1.518 ms (-7.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.995 ms [17.815 ms, 18.176 ms] -
appsec 18.736 ms [18.547 ms, 18.926 ms] 740.994 µs (4.1%)
code_origins 17.819 ms [17.641 ms, 17.997 ms] -175.922 µs (-1.0%)
iast 17.757 ms [17.578 ms, 17.937 ms] -237.79 µs (-1.3%)
profiling 18.464 ms [18.275 ms, 18.652 ms] 468.23 µs (2.6%)
tracing 18.01 ms [17.828 ms, 18.193 ms] 15.048 µs (0.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.186 ms) : 1174, 1197
.   : milestone, 1186,
iast (3.299 ms) : 3251, 3347
.   : milestone, 3299,
iast_FULL (5.464 ms) : 5409, 5518
.   : milestone, 5464,
iast_GLOBAL (3.524 ms) : 3474, 3574
.   : milestone, 3524,
profiling (2.092 ms) : 2073, 2111
.   : milestone, 2092,
tracing (1.805 ms) : 1790, 1821
.   : milestone, 1805,
section candidate
no_agent (1.207 ms) : 1195, 1219
.   : milestone, 1207,
iast (3.241 ms) : 3200, 3282
.   : milestone, 3241,
iast_FULL (5.983 ms) : 5923, 6044
.   : milestone, 5983,
iast_GLOBAL (3.743 ms) : 3649, 3837
.   : milestone, 3743,
profiling (2.162 ms) : 2143, 2182
.   : milestone, 2162,
tracing (1.815 ms) : 1799, 1831
.   : milestone, 1815,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.174 ms, 1.197 ms] -
iast 3.299 ms [3.251 ms, 3.347 ms] 2.113 ms (178.2%)
iast_FULL 5.464 ms [5.409 ms, 5.518 ms] 4.278 ms (360.7%)
iast_GLOBAL 3.524 ms [3.474 ms, 3.574 ms] 2.338 ms (197.2%)
profiling 2.092 ms [2.073 ms, 2.111 ms] 906.072 µs (76.4%)
tracing 1.805 ms [1.79 ms, 1.821 ms] 619.607 µs (52.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.207 ms [1.195 ms, 1.219 ms] -
iast 3.241 ms [3.2 ms, 3.282 ms] 2.034 ms (168.6%)
iast_FULL 5.983 ms [5.923 ms, 6.044 ms] 4.777 ms (395.8%)
iast_GLOBAL 3.743 ms [3.649 ms, 3.837 ms] 2.536 ms (210.2%)
profiling 2.162 ms [2.143 ms, 2.182 ms] 955.673 µs (79.2%)
tracing 1.815 ms [1.799 ms, 1.831 ms] 608.151 µs (50.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
release_version 1.56.0-SNAPSHOT~5db793a092 1.56.0-SNAPSHOT~7beade4bca
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1762931307 1762931307
ci_job_id 1229112901 1229112901
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-aranydp7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-aranydp7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.704 ms) : 3486, 3922
.   : milestone, 3704,
iast (2.211 ms) : 2148, 2274
.   : milestone, 2211,
iast_GLOBAL (2.257 ms) : 2193, 2320
.   : milestone, 2257,
profiling (2.081 ms) : 2028, 2134
.   : milestone, 2081,
tracing (2.026 ms) : 1977, 2075
.   : milestone, 2026,
section candidate
no_agent (1.484 ms) : 1473, 1496
.   : milestone, 1484,
appsec (3.714 ms) : 3495, 3932
.   : milestone, 3714,
iast (2.209 ms) : 2146, 2272
.   : milestone, 2209,
iast_GLOBAL (2.254 ms) : 2190, 2317
.   : milestone, 2254,
profiling (2.058 ms) : 2007, 2109
.   : milestone, 2058,
tracing (2.033 ms) : 1983, 2082
.   : milestone, 2033,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.704 ms [3.486 ms, 3.922 ms] 2.227 ms (150.8%)
iast 2.211 ms [2.148 ms, 2.274 ms] 734.185 µs (49.7%)
iast_GLOBAL 2.257 ms [2.193 ms, 2.32 ms] 779.76 µs (52.8%)
profiling 2.081 ms [2.028 ms, 2.134 ms] 604.551 µs (40.9%)
tracing 2.026 ms [1.977 ms, 2.075 ms] 549.065 µs (37.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.473 ms, 1.496 ms] -
appsec 3.714 ms [3.495 ms, 3.932 ms] 2.229 ms (150.2%)
iast 2.209 ms [2.146 ms, 2.272 ms] 724.71 µs (48.8%)
iast_GLOBAL 2.254 ms [2.19 ms, 2.317 ms] 769.261 µs (51.8%)
profiling 2.058 ms [2.007 ms, 2.109 ms] 573.737 µs (38.6%)
tracing 2.033 ms [1.983 ms, 2.082 ms] 548.049 µs (36.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.811 s) : 14811000, 14811000
.   : milestone, 14811000,
appsec (14.809 s) : 14809000, 14809000
.   : milestone, 14809000,
iast (18.387 s) : 18387000, 18387000
.   : milestone, 18387000,
iast_GLOBAL (17.86 s) : 17860000, 17860000
.   : milestone, 17860000,
profiling (15.813 s) : 15813000, 15813000
.   : milestone, 15813000,
tracing (14.829 s) : 14829000, 14829000
.   : milestone, 14829000,
section candidate
no_agent (15.249 s) : 15249000, 15249000
.   : milestone, 15249000,
appsec (14.628 s) : 14628000, 14628000
.   : milestone, 14628000,
iast (18.605 s) : 18605000, 18605000
.   : milestone, 18605000,
iast_GLOBAL (18.047 s) : 18047000, 18047000
.   : milestone, 18047000,
profiling (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
tracing (14.758 s) : 14758000, 14758000
.   : milestone, 14758000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.811 s [14.811 s, 14.811 s] -
appsec 14.809 s [14.809 s, 14.809 s] -2.0 ms (-0.0%)
iast 18.387 s [18.387 s, 18.387 s] 3.576 s (24.1%)
iast_GLOBAL 17.86 s [17.86 s, 17.86 s] 3.049 s (20.6%)
profiling 15.813 s [15.813 s, 15.813 s] 1.002 s (6.8%)
tracing 14.829 s [14.829 s, 14.829 s] 18.0 ms (0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.249 s [15.249 s, 15.249 s] -
appsec 14.628 s [14.628 s, 14.628 s] -621.0 ms (-4.1%)
iast 18.605 s [18.605 s, 18.605 s] 3.356 s (22.0%)
iast_GLOBAL 18.047 s [18.047 s, 18.047 s] 2.798 s (18.3%)
profiling 14.957 s [14.957 s, 14.957 s] -292.0 ms (-1.9%)
tracing 14.758 s [14.758 s, 14.758 s] -491.0 ms (-3.2%)

@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from d56be96 to 3ff89a2 Compare October 29, 2025 08:41
@jpbempel jpbempel requested a review from a team as a code owner October 29, 2025 12:26
@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from 8dddbde to 778754a Compare October 29, 2025 15:27
@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025 •
edited
Loading

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
See matching parameters
Baseline Candidate
ci_job_date 1762930397 1762930397
ci_job_id 1229112904 1229112904
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025 •
edited
Loading

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
See matching parameters
Baseline Candidate
ci_job_date 1762930438 1762930438
ci_job_id 1229112905 1229112905
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from 778754a to 24b88d7 Compare October 30, 2025 09:53
@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch 6 times, most recently from ad98e42 to 71e7de7 Compare November 5, 2025 07:44
mcculls
mcculls reviewed Nov 11, 2025
View reviewed changes
Copy link
Contributor

@mcculls mcculls left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code changes look ok - just need some reassurance about the performance impact

@jpbempel
Make Code Origin for Spans default on
36828d1 
by default Code Origin will be started
@jpbempel
fix tests
7beade4
@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from 71e7de7 to 7beade4 Compare November 12, 2025 06:34
@tylfin
Copy link
Member

tylfin commented Nov 12, 2025

@mcculls We have a link to the benchmarking results in https://datadoghq.atlassian.net/browse/DEBUG-4173, this is still a WIP but startup time, latency, memory, CPU all look nominal to move this to a default-on feature. We also have about 190 orgs using this in production today.

@jpbempel jpbempel merged commit d422f6d into master Nov 12, 2025
543 checks passed
@jpbempel jpbempel deleted the jpbempel/code-origin-default-on branch November 12, 2025 15:37
@github-actions github-actions bot added this to the 1.56.0 milestone Nov 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@tylfin tylfin tylfin approved these changes

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.56.0

Development

Successfully merging this pull request may close these issues.

3 participants

@jpbempel @tylfin @mcculls