Skip to content

New Profiling API #1202

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 45 commits into
base: main
Choose a base branch
from
Draft

New Profiling API #1202

wants to merge 45 commits into from

Conversation

morrisonlevi
Copy link
Contributor

Work in Progress

This PR is a giant work in progress. It's huge by design and not really ready for review. .NET will be doing a PoC soon with it and I'm doing a PoC in PHP as I write it. After that, we'll be ready for review.

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@morrisonlevi morrisonlevi added the profiling Relates to the profiling* modules. label Sep 4, 2025
@codecov-commenter
Copy link

codecov-commenter commented Sep 8, 2025 •
edited
Loading

Codecov Report

❌ Patch coverage is 45.62235% with 2180 lines in your changes missing coverage. Please review.
✅ Project coverage is 69.21%. Comparing base (0cc3f7f) to head (6d9a85a).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1202      +/-   ##
==========================================
- Coverage   71.69%   69.21%   -2.48%     
==========================================
  Files         354      364      +10     
  Lines       56138    54444    -1694     
==========================================
- Hits        40247    37685    -2562     
- Misses      15891    16759     +868
Components Coverage Δ
datadog-crashtracker 49.33% <ø> (+0.02%) ⬆️
datadog-crashtracker-ffi 5.93% <ø> (ø)
datadog-alloc 98.72% <100.00%> (-0.01%) ⬇️
data-pipeline 90.30% <ø> (ø)
data-pipeline-ffi 88.19% <ø> (ø)
ddcommon 83.85% <ø> (-0.45%) ⬇️
ddcommon-ffi 73.51% <ø> (-0.33%) ⬇️
ddtelemetry 60.02% <ø> (ø)
ddtelemetry-ffi 21.24% <ø> (ø)
dogstatsd-client 83.26% <ø> (ø)
datadog-ipc 82.39% <ø> (ø)
datadog-profiling 53.45% <45.54%> (-23.45%) ⬇️
datadog-profiling-ffi 54.61% <41.89%> (-7.51%) ⬇️
datadog-sidecar 36.87% <ø> (-0.21%) ⬇️
datdog-sidecar-ffi 10.36% <ø> (-1.01%) ⬇️
spawn-worker 55.35% <ø> (ø)
tinybytes 92.22% <ø> (ø)
datadog-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
datadog-trace-protobuf 77.10% <ø> (ø)
datadog-trace-utils 89.75% <ø> (ø)
datadog-tracer-flare 54.62% <ø> (+0.10%) ⬆️
datadog-log 76.31% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@datadog-datadog-prod-us1
Copy link

datadog-datadog-prod-us1 bot commented Sep 9, 2025 •
edited by datadog-official bot
Loading

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 6d9a85a | Docs | Was this helpful? Give us feedback!

@github-actions github-actions bot removed the sidecar label Sep 9, 2025
@pr-commenter
Copy link

pr-commenter bot commented Sep 10, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-09-24 01:12:23

Comparing candidate commit 6d9a85a in PR branch levi/new-ffi with baseline commit 0cc3f7f in branch main.

Found 2 performance improvements and 5 performance regressions! Performance is the same for 45 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/x371413321323331

  • 🟥 execution_time [+739.528ns; +742.538ns] or [+12.980%; +13.033%]
  • 🟥 throughput [-20238168.280op/s; -20164106.884op/s] or [-11.530%; -11.488%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟥 execution_time [+736.342ns; +737.949ns] or [+12.922%; +12.950%]
  • 🟥 throughput [-20121508.312op/s; -20078487.312op/s] or [-11.466%; -11.442%]

scenario:normalization/normalize_name/normalize_name/good

  • 🟩 execution_time [-668.809ns; -651.682ns] or [-6.350%; -6.188%]
  • 🟩 throughput [+6268473.168op/s; +6430580.870op/s] or [+6.602%; +6.773%]

scenario:normalization/normalize_service/normalize_service/[empty string]

  • 🟥 execution_time [+1.507µs; +1.544µs] or [+4.066%; +4.164%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.908µs 90.196µs ± 0.161µs 90.182µs ± 0.054µs 90.241µs 90.330µs 90.629µs 91.756µs 1.75% 5.491 46.952 0.18% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [90.174µs; 90.218µs] or [-0.025%; +0.025%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.155ms 60.702ms ± 2.426ms 60.368ms ± 0.081ms 60.461ms 60.745ms 77.016ms 83.358ms 38.08% 8.130 65.575 3.99% 0.172ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.365ms; 61.038ms] or [-0.554%; +0.554%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.246ms 6.309ms ± 0.036ms 6.306ms ± 0.019ms 6.324ms 6.361ms 6.386ms 6.638ms 5.25% 4.135 34.643 0.56% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.304ms; 6.314ms] or [-0.078%; +0.078%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.088ms 14.144ms ± 0.032ms 14.141ms ± 0.014ms 14.154ms 14.191ms 14.262ms 14.320ms 1.27% 2.177 7.361 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.140ms; 14.149ms] or [-0.032%; +0.032%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.304µs 2.361µs ± 0.019µs 2.360µs ± 0.006µs 2.367µs 2.394µs 2.401µs 2.408µs 2.05% -0.678 2.058 0.79% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.358µs; 2.363µs] or [-0.110%; +0.110%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 241.718ns 253.448ns ± 13.583ns 246.340ns ± 3.604ns 257.281ns 282.456ns 290.510ns 292.093ns 18.57% 1.284 0.312 5.35% 0.960ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [251.565ns; 255.330ns] or [-0.743%; +0.743%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.013µs 5.073µs ± 0.034µs 5.085µs ± 0.023µs 5.104µs 5.112µs 5.117µs 5.117µs 0.63% -0.449 -1.329 0.66% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.069µs; 5.078µs] or [-0.092%; +0.092%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.890µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.918µs 3.920µs 3.920µs 0.17% -1.534 10.191 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 255088552.739op/s 255547101.756op/s ± 214988.141op/s 255531336.542op/s ± 145690.733op/s 255697647.583op/s 255819788.896op/s 255919536.753op/s 257050776.123op/s 0.59% 1.559 10.396 0.08% 15201.957op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.397µs 81.670µs ± 0.954µs 81.690µs ± 0.641µs 82.248µs 83.324µs 83.721µs 83.904µs 2.71% 0.028 -0.338 1.17% 0.067µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11918414.351op/s 12246051.591op/s ± 143056.441op/s 12241346.387op/s ± 95985.903op/s 12344431.726op/s 12487273.252op/s 12549493.914op/s 12594917.414op/s 2.89% 0.030 -0.342 1.17% 10115.618op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.490µs 72.270µs ± 0.491µs 72.154µs ± 0.311µs 72.564µs 73.115µs 73.675µs 74.205µs 2.84% 0.928 1.011 0.68% 0.035µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13476139.042op/s 13837662.518op/s ± 93394.335op/s 13859209.587op/s ± 59827.487op/s 13910382.710op/s 13960155.573op/s 13979651.514op/s 13988018.206op/s 0.93% -0.886 0.866 0.67% 6603.977op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.918µs 3.919µs 0.19% -1.017 8.673 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255161732.092op/s 255630732.165op/s ± 178344.047op/s 255649184.083op/s ± 99288.346op/s 255736677.903op/s 255862598.240op/s 255895893.844op/s 256820080.898op/s 0.46% 1.037 8.814 0.07% 12610.828op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.510µs 69.370µs ± 0.432µs 69.320µs ± 0.290µs 69.689µs 70.087µs 70.427µs 70.689µs 1.97% 0.416 -0.271 0.62% 0.031µs 1 200
credit_card/is_card_number/378282246310005 throughput 14146449.114op/s 14415977.587op/s ± 89504.262op/s 14425749.963op/s ± 60160.124op/s 14481809.412op/s 14546997.094op/s 14589393.594op/s 14596366.672op/s 1.18% -0.387 -0.307 0.62% 6328.907op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.354µs 45.672µs ± 0.172µs 45.671µs ± 0.136µs 45.815µs 45.923µs 45.968µs 46.006µs 0.73% -0.166 -0.978 0.38% 0.012µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21736297.423op/s 21895395.403op/s ± 82545.445op/s 21895809.148op/s ± 65370.315op/s 21954990.666op/s 22036642.297op/s 22048237.200op/s 22049009.410op/s 0.70% 0.178 -0.974 0.38% 5836.844op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.426µs 6.438µs ± 0.010µs 6.436µs ± 0.003µs 6.440µs 6.447µs 6.485µs 6.491µs 0.87% 3.483 12.833 0.16% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154047968.627op/s 155318156.065op/s ± 249949.117op/s 155380641.944op/s ± 73618.871op/s 155436200.368op/s 155504351.518op/s 155547773.526op/s 155611263.762op/s 0.15% -3.470 12.757 0.16% 17674.072op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.913µs 3.917µs 3.919µs 3.920µs 0.23% -0.695 7.199 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255070918.593op/s 255630335.948op/s ± 187167.761op/s 255645458.042op/s ± 105551.506op/s 255746002.312op/s 255853473.714op/s 255943863.570op/s 256817335.180op/s 0.46% 0.715 7.315 0.07% 13234.759op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 59.996µs 61.922µs ± 0.593µs 61.965µs ± 0.406µs 62.355µs 62.805µs 63.052µs 63.256µs 2.08% -0.348 -0.217 0.96% 0.042µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15808660.613op/s 16150862.342op/s ± 155351.631op/s 16138098.072op/s ± 105718.413op/s 16246782.805op/s 16428035.037op/s 16494799.802op/s 16667707.104op/s 3.28% 0.396 -0.153 0.96% 10985.019op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.985µs 54.254µs ± 0.081µs 54.253µs ± 0.051µs 54.307µs 54.390µs 54.411µs 54.444µs 0.35% -0.317 0.477 0.15% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18367566.174op/s 18431828.873op/s ± 27504.909op/s 18432154.008op/s ± 17381.655op/s 18447466.229op/s 18474088.338op/s 18513479.105op/s 18523571.244op/s 0.50% 0.328 0.495 0.15% 1944.891op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.915µs 3.919µs 3.921µs 3.923µs 0.28% -0.130 4.214 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254900123.413op/s 255568478.513op/s ± 211966.745op/s 255618176.622op/s ± 125097.952op/s 255720208.304op/s 255787998.767op/s 255885838.114op/s 256750829.796op/s 0.44% 0.146 4.284 0.08% 14988.312op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.211µs 50.464µs ± 0.110µs 50.470µs ± 0.067µs 50.526µs 50.636µs 50.728µs 50.900µs 0.85% 0.282 0.867 0.22% 0.008µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19646307.235op/s 19816059.780op/s ± 43152.496op/s 19813658.033op/s ± 26437.788op/s 19844171.400op/s 19885111.142op/s 19911504.991op/s 19916100.175op/s 0.52% -0.264 0.831 0.22% 3051.342op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.361µs 45.646µs ± 0.156µs 45.654µs ± 0.117µs 45.747µs 45.900µs 45.934µs 45.961µs 0.67% 0.012 -0.917 0.34% 0.011µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21757508.219op/s 21908189.258op/s ± 74661.804op/s 21904080.934op/s ± 56047.160op/s 21966848.744op/s 22025205.426op/s 22042422.450op/s 22045422.388op/s 0.65% -0.001 -0.920 0.34% 5279.387op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.427µs 6.436µs ± 0.005µs 6.435µs ± 0.003µs 6.439µs 6.444µs 6.447µs 6.449µs 0.21% 0.467 -0.174 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 155059146.628op/s 155383971.345op/s ± 111352.931op/s 155392264.164op/s ± 76507.785op/s 155465485.236op/s 155544492.626op/s 155576423.211op/s 155585281.172op/s 0.12% -0.464 -0.179 0.07% 7873.841op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.914µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [255517306.467op/s; 255576897.044op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [81.538µs; 81.802µs] or [-0.162%; +0.162%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12226225.345op/s; 12265877.838op/s] or [-0.162%; +0.162%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.202µs; 72.338µs] or [-0.094%; +0.094%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13824718.962op/s; 13850606.075op/s] or [-0.094%; +0.094%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255606015.396op/s; 255655448.935op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.310µs; 69.430µs] or [-0.086%; +0.086%] None None None
credit_card/is_card_number/378282246310005 throughput [14403573.157op/s; 14428382.017op/s] or [-0.086%; +0.086%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.649µs; 45.696µs] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21883955.398op/s; 21906835.408op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.437µs; 6.440µs] or [-0.022%; +0.022%] None None None
credit_card/is_card_number/x371413321323331 throughput [155283515.521op/s; 155352796.609op/s] or [-0.022%; +0.022%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255604396.296op/s; 255656275.599op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [61.840µs; 62.004µs] or [-0.133%; +0.133%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [16129332.100op/s; 16172392.584op/s] or [-0.133%; +0.133%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [54.243µs; 54.265µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18428016.957op/s; 18435640.789op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255539101.961op/s; 255597855.065op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.449µs; 50.480µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19810079.259op/s; 19822040.301op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.624µs; 45.667µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21897841.850op/s; 21918536.666op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.435µs; 6.436µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155368538.900op/s; 155399403.790op/s] or [-0.010%; +0.010%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.429µs 535.375µs ± 0.715µs 535.322µs ± 0.287µs 535.605µs 536.058µs 536.418µs 541.379µs 1.13% 5.781 45.921 0.13% 0.051µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1847133.412op/s 1867853.159op/s ± 2475.297op/s 1868032.822op/s ± 1001.292op/s 1869035.167op/s 1870214.414op/s 1870918.348op/s 1871155.326op/s 0.17% -5.723 45.295 0.13% 175.030op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 379.616µs 380.875µs ± 0.731µs 380.663µs ± 0.469µs 381.339µs 382.050µs 382.362µs 386.490µs 1.53% 2.474 15.717 0.19% 0.052µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2587388.192op/s 2625541.543op/s ± 5017.527op/s 2626996.583op/s ± 3234.778op/s 2629053.747op/s 2631537.186op/s 2632445.802op/s 2634240.012op/s 0.28% -2.408 15.063 0.19% 354.793op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 194.895µs 195.196µs ± 0.166µs 195.186µs ± 0.110µs 195.285µs 195.496µs 195.638µs 195.868µs 0.35% 0.719 0.934 0.08% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5105475.085op/s 5123061.479op/s ± 4348.975op/s 5123321.379op/s ± 2878.317op/s 5126470.880op/s 5129427.296op/s 5130443.913op/s 5130977.656op/s 0.15% -0.713 0.916 0.08% 307.519op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 38.366µs 38.602µs ± 0.065µs 38.601µs ± 0.046µs 38.649µs 38.698µs 38.738µs 38.762µs 0.42% -0.271 0.146 0.17% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 25798609.872op/s 25905515.565op/s ± 43832.511op/s 25906126.902op/s ± 31006.494op/s 25934786.978op/s 25974416.842op/s 26011791.084op/s 26064952.300op/s 0.61% 0.282 0.163 0.17% 3099.427op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.811µs 45.957µs ± 0.246µs 45.924µs ± 0.030µs 45.956µs 46.041µs 47.378µs 48.118µs 4.78% 7.731 62.132 0.53% 0.017µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20782303.382op/s 21759931.311op/s ± 111786.963op/s 21775142.009op/s ± 14380.476op/s 21789394.951op/s 21808694.319op/s 21823899.933op/s 21828833.613op/s 0.25% -7.662 61.201 0.51% 7904.532op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.276µs; 535.474µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1867510.106op/s; 1868196.211op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.774µs; 380.977µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2624846.162op/s; 2626236.924op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [195.173µs; 195.219µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5122458.753op/s; 5123664.205op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [38.593µs; 38.611µs] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [25899440.801op/s; 25911590.330op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.923µs; 45.991µs] or [-0.074%; +0.074%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21744438.713op/s; 21775423.909op/s] or [-0.071%; +0.071%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.170ms 8.187ms ± 0.010ms 8.186ms ± 0.006ms 8.192ms 8.203ms 8.215ms 8.232ms 0.56% 1.181 3.190 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.186ms; 8.188ms] or [-0.016%; +0.016%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.353µs 34.993µs ± 1.134µs 34.469µs ± 0.057µs 34.606µs 37.418µs 37.542µs 38.073µs 10.46% 1.700 0.940 3.23% 0.080µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.835µs; 35.150µs] or [-0.449%; +0.449%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.223µs 3.166µs ± 1.427µs 2.992µs ± 0.021µs 3.011µs 3.322µs 13.754µs 15.134µs 405.75% 7.507 56.956 44.97% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.968µs; 3.363µs] or [-6.249%; +6.249%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.475µs 27.328µs ± 10.759µs 18.837µs ± 0.264µs 37.155µs 47.322µs 47.919µs 78.251µs 315.42% 0.964 0.863 39.27% 0.761µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.837µs; 28.820µs] or [-5.456%; +5.456%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d9a85a 1758675577 levi/new-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.302µs 185.753µs ± 0.309µs 185.692µs ± 0.166µs 185.895µs 186.137µs 187.005µs 187.693µs 1.08% 2.493 10.834 0.17% 0.022µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5327852.749op/s 5383505.542op/s ± 8930.096op/s 5385251.466op/s ± 4809.383op/s 5389194.853op/s 5393455.440op/s 5395750.206op/s 5396594.371op/s 0.21% -2.460 10.597 0.17% 631.453op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.345µs 17.450µs ± 0.047µs 17.449µs ± 0.031µs 17.481µs 17.527µs 17.567µs 17.643µs 1.11% 0.433 0.781 0.27% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 56679541.020op/s 57307548.188op/s ± 154840.796op/s 57310454.137op/s ± 103011.352op/s 57410591.759op/s 57559197.415op/s 57624974.394op/s 57654731.491op/s 0.60% -0.412 0.733 0.27% 10948.898op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 9.823µs 9.872µs ± 0.037µs 9.869µs ± 0.035µs 9.903µs 9.929µs 9.946µs 9.974µs 1.06% 0.274 -1.166 0.37% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 100256032.641op/s 101298820.205op/s ± 380131.075op/s 101322916.896op/s ± 358406.912op/s 101686415.273op/s 101752321.439op/s 101771809.426op/s 101806525.953op/s 0.48% -0.265 -1.182 0.37% 26879.326op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.710µs; 185.796µs] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5382267.916op/s; 5384743.167op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.443µs; 17.456µs] or [-0.037%; +0.037%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [57286088.742op/s; 57329007.633op/s] or [-0.037%; +0.037%] None None None
normalization/normalize_name/normalize_name/good execution_time [9.867µs; 9.877µs] or [-0.052%; +0.052%] None None None
normalization/normalize_name/normalize_name/good throughput [101246137.694op/s; 101351502.716op/s] or [-0.052%; +0.052%] None None None

Baseline

Omitted due to size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
common data-pipeline profiling Relates to the profiling* modules.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@morrisonlevi @codecov-commenter