[DO NOT MERGE] Runtime stack registration experiment

[gyuheon0h]

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2025-09-24 21:11:14

Comparing candidate commit 9b2bbe4 in PR branch gyuheon/prof-12432-test with baseline commit f61c42a in branch main.

Found 13 performance improvements and 4 performance regressions! Performance is the same for 36 metrics, 2 unstable metrics.

scenario:concentrator/add_spans_to_concentrator

• 🟩 execution_time [-3.517ms; -3.511ms] or [-29.917%; -29.868%]

scenario:credit_card/is_card_number/ 378282246310005

• 🟥 execution_time [+10.800µs; +11.030µs] or [+15.207%; +15.532%]
• 🟥 throughput [-1897132.395op/s; -1855976.917op/s] or [-13.471%; -13.179%]

scenario:credit_card/is_card_number/37828224631000521389798

• 🟩 execution_time [-7.117µs; -7.081µs] or [-13.635%; -13.567%]
• 🟩 throughput [+3007612.539op/s; +3024734.108op/s] or [+15.698%; +15.787%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

• 🟩 execution_time [-5.027µs; -4.987µs] or [-8.666%; -8.597%]
• 🟩 throughput [+1622239.930op/s; +1634314.401op/s] or [+9.411%; +9.481%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

• 🟩 execution_time [-5.082µs; -5.021µs] or [-9.266%; -9.156%]
• 🟩 throughput [+1839594.263op/s; +1859740.147op/s] or [+10.089%; +10.199%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

• 🟩 execution_time [-7.082µs; -7.045µs] or [-13.566%; -13.496%]
• 🟩 throughput [+2989173.784op/s; +3006763.699op/s] or [+15.604%; +15.696%]

scenario:normalization/normalize_name/normalize_name/good

• 🟥 execution_time [+653.055ns; +667.916ns] or [+6.530%; +6.678%]
• 🟥 throughput [-6263205.650op/s; -6124755.779op/s] or [-6.264%; -6.125%]

scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...

• 🟩 execution_time [-39.649µs; -39.470µs] or [-7.411%; -7.378%]
• 🟩 throughput [+148918.203op/s; +149609.141op/s] or [+7.967%; +8.004%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

• 🟩 execution_time [-27.357µs; -27.281µs] or [-14.041%; -14.002%]
• 🟩 throughput [+835935.247op/s; +838153.999op/s] or [+16.287%; +16.330%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	59.739ms	60.408ms ± 2.181ms	60.140ms ± 0.123ms	60.273ms	60.531ms	69.991ms	82.058ms	36.45%	8.771	78.124	3.60%	0.154ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[60.106ms; 60.711ms] or [-0.500%; +0.500%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	249.205ns	259.517ns ± 13.116ns	253.269ns ± 2.323ns	265.757ns	291.107ns	298.564ns	299.990ns	18.45%	1.652	1.557	5.04%	0.927ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[257.699ns; 261.335ns] or [-0.700%; +0.700%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
receiver_entry_point/report/2597	execution_time	6.223ms	6.284ms ± 0.033ms	6.280ms ± 0.017ms	6.298ms	6.331ms	6.393ms	6.533ms	4.03%	2.711	15.775	0.52%	0.002ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
receiver_entry_point/report/2597	execution_time	[6.280ms; 6.289ms] or [-0.073%; +0.073%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	8.225ms	8.241ms ± 0.010ms	8.239ms ± 0.006ms	8.246ms	8.258ms	8.269ms	8.303ms	0.78%	1.915	7.651	0.12%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[8.240ms; 8.242ms] or [-0.016%; +0.016%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching serializing traces from their internal representation to msgpack	execution_time	14.826ms	14.894ms ± 0.030ms	14.891ms ± 0.012ms	14.902ms	14.932ms	15.008ms	15.099ms	1.40%	2.807	13.842	0.20%	0.002ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching serializing traces from their internal representation to msgpack	execution_time	[14.890ms; 14.898ms] or [-0.028%; +0.028%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	3.890µs	3.912µs ± 0.003µs	3.912µs ± 0.002µs	3.913µs	3.917µs	3.920µs	3.923µs	0.30%	-0.999	11.088	0.08%	0.000µs	1	200
credit_card/is_card_number/	throughput	254879873.033op/s	255644283.946op/s ± 205462.716op/s	255645176.912op/s ± 121239.172op/s	255782573.010op/s	255867905.637op/s	255957842.018op/s	257069589.653op/s	0.56%	1.028	11.277	0.08%	14528.408op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	77.250µs	77.933µs ± 0.518µs	77.869µs ± 0.346µs	78.217µs	78.918µs	79.435µs	80.041µs	2.79%	1.028	1.144	0.66%	0.037µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	12493554.682op/s	12832136.615op/s ± 84773.946op/s	12842028.520op/s ± 56996.996op/s	12898289.395op/s	12934481.258op/s	12938794.553op/s	12945021.490op/s	0.80%	-0.987	0.999	0.66%	5994.423op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	80.959µs	81.930µs ± 0.535µs	81.841µs ± 0.331µs	82.189µs	82.996µs	83.521µs	83.801µs	2.39%	0.847	0.800	0.65%	0.038µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	11933023.655op/s	12206039.244op/s ± 79321.623op/s	12218761.306op/s ± 49363.953op/s	12262462.534op/s	12313226.652op/s	12350236.254op/s	12351987.501op/s	1.09%	-0.807	0.708	0.65%	5608.886op/s	1	200
credit_card/is_card_number/37828224631	execution_time	3.896µs	3.911µs ± 0.003µs	3.911µs ± 0.002µs	3.913µs	3.916µs	3.917µs	3.923µs	0.31%	0.050	5.379	0.07%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	254932881.466op/s	255696660.602op/s ± 177962.582op/s	255712402.052op/s ± 107232.003op/s	255814867.271op/s	255906798.284op/s	255963852.403op/s	256677917.197op/s	0.38%	-0.035	5.420	0.07%	12583.855op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	67.567µs	67.789µs ± 0.193µs	67.716µs ± 0.098µs	67.884µs	68.147µs	68.404µs	69.003µs	1.90%	2.010	7.479	0.28%	0.014µs	1	200
credit_card/is_card_number/378282246310005	throughput	14492154.750op/s	14751742.238op/s ± 41704.256op/s	14767492.354op/s ± 21376.811op/s	14782914.277op/s	14794151.058op/s	14798079.255op/s	14800204.243op/s	0.22%	-1.965	7.115	0.28%	2948.936op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	44.667µs	45.096µs ± 0.123µs	45.087µs ± 0.086µs	45.176µs	45.293µs	45.380µs	45.392µs	0.67%	-0.045	0.174	0.27%	0.009µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	22030503.912op/s	22175321.119op/s ± 60669.921op/s	22179177.170op/s ± 42129.399op/s	22214249.886op/s	22264873.497op/s	22321287.273op/s	22387734.587op/s	0.94%	0.063	0.197	0.27%	4290.011op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	6.025µs	6.036µs ± 0.018µs	6.035µs ± 0.002µs	6.037µs	6.042µs	6.105µs	6.249µs	3.55%	9.321	101.529	0.30%	0.001µs	1	200
credit_card/is_card_number/x371413321323331	throughput	160024707.738op/s	165667742.136op/s ± 477844.113op/s	165707705.408op/s ± 65475.322op/s	165815017.588op/s	165905604.338op/s	165945701.197op/s	165964879.948op/s	0.16%	-9.175	98.787	0.29%	33788.681op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	3.894µs	3.912µs ± 0.003µs	3.912µs ± 0.002µs	3.914µs	3.916µs	3.919µs	3.920µs	0.21%	-0.866	5.850	0.08%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	255103466.055op/s	255643043.409op/s ± 194237.497op/s	255648192.895op/s ± 103925.294op/s	255745516.334op/s	255939041.965op/s	256012275.084op/s	256820404.698op/s	0.46%	0.882	5.942	0.08%	13734.665op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	65.347µs	65.417µs ± 0.040µs	65.414µs ± 0.027µs	65.439µs	65.490µs	65.529µs	65.558µs	0.22%	0.661	0.338	0.06%	0.003µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	15253771.919op/s	15286583.028op/s ± 9322.848op/s	15287338.262op/s ± 6240.492op/s	15293666.128op/s	15299597.774op/s	15302539.319op/s	15302977.960op/s	0.10%	-0.657	0.330	0.06%	659.225op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	52.940µs	53.005µs ± 0.039µs	52.998µs ± 0.023µs	53.025µs	53.072µs	53.133µs	53.165µs	0.32%	1.092	2.184	0.07%	0.003µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	18809314.651op/s	18866283.640op/s ± 13751.483op/s	18868570.624op/s ± 8224.325op/s	18875384.140op/s	18884889.916op/s	18888553.725op/s	18889374.727op/s	0.11%	-1.085	2.160	0.07%	972.377op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	3.891µs	3.910µs ± 0.003µs	3.910µs ± 0.002µs	3.912µs	3.914µs	3.917µs	3.918µs	0.19%	-1.415	11.993	0.07%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	255253841.810op/s	255724915.608op/s ± 175530.003op/s	255728807.851op/s ± 107136.639op/s	255834716.167op/s	255934146.473op/s	255966499.048op/s	256986603.430op/s	0.49%	1.439	12.186	0.07%	12411.846op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	49.731µs	49.791µs ± 0.038µs	49.789µs ± 0.027µs	49.814µs	49.856µs	49.882µs	50.015µs	0.45%	1.374	5.078	0.08%	0.003µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	19994097.265op/s	20084122.827op/s ± 15233.423op/s	20084898.167op/s ± 11007.292op/s	20095945.643op/s	20104016.380op/s	20106551.620op/s	20108157.880op/s	0.12%	-1.363	4.997	0.08%	1077.166op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	44.668µs	45.137µs ± 0.126µs	45.144µs ± 0.083µs	45.228µs	45.326µs	45.383µs	45.426µs	0.62%	-0.409	0.354	0.28%	0.009µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	22013955.658op/s	22154754.391op/s ± 61922.214op/s	22151153.391op/s ± 40658.883op/s	22190514.665op/s	22255487.890op/s	22295190.401op/s	22387271.767op/s	1.07%	0.427	0.391	0.28%	4378.562op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	6.026µs	6.034µs ± 0.005µs	6.033µs ± 0.003µs	6.036µs	6.042µs	6.048µs	6.049µs	0.27%	1.007	1.559	0.07%	0.000µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	165306428.067op/s	165735042.545op/s ± 123647.902op/s	165746695.864op/s ± 72497.710op/s	165820441.520op/s	165899076.673op/s	165937422.572op/s	165952726.294op/s	0.12%	-1.001	1.543	0.07%	8743.227op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[3.911µs; 3.912µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/	throughput	[255615808.790op/s; 255672759.103op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[77.861µs; 78.005µs] or [-0.092%; +0.092%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[12820387.761op/s; 12843885.469op/s] or [-0.092%; +0.092%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[81.856µs; 82.004µs] or [-0.091%; +0.091%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[12195046.030op/s; 12217032.458op/s] or [-0.090%; +0.090%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[3.911µs; 3.911µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[255671996.700op/s; 255721324.504op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[67.762µs; 67.816µs] or [-0.039%; +0.039%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[14745962.430op/s; 14757522.047op/s] or [-0.039%; +0.039%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[45.078µs; 45.113µs] or [-0.038%; +0.038%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[22166912.851op/s; 22183729.386op/s] or [-0.038%; +0.038%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[6.034µs; 6.039µs] or [-0.041%; +0.041%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[165601517.537op/s; 165733966.734op/s] or [-0.040%; +0.040%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[3.911µs; 3.912µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[255616123.960op/s; 255669962.858op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[65.411µs; 65.422µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[15285290.971op/s; 15287875.085op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[52.999µs; 53.010µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[18864377.817op/s; 18868189.463op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[3.910µs; 3.911µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[255700588.837op/s; 255749242.378op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[49.785µs; 49.796µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[20082011.621op/s; 20086234.033op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[45.120µs; 45.155µs] or [-0.039%; +0.039%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[22146172.567op/s; 22163336.214op/s] or [-0.039%; +0.039%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[6.033µs; 6.034µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[165717906.135op/s; 165752178.955op/s] or [-0.010%; +0.010%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	86.291µs	86.747µs ± 0.491µs	86.693µs ± 0.043µs	86.743µs	86.859µs	87.560µs	93.235µs	7.55%	11.888	151.784	0.56%	0.035µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[86.678µs; 86.815µs] or [-0.078%; +0.078%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	17.557µs	25.725µs ± 10.510µs	17.759µs ± 0.163µs	35.315µs	45.273µs	46.301µs	75.686µs	326.19%	1.106	1.221	40.75%	0.743µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[24.268µs; 27.181µs] or [-5.662%; +5.662%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	160.568µs	161.637µs ± 0.419µs	161.555µs ± 0.160µs	161.725µs	162.321µs	163.234µs	164.493µs	1.82%	2.881	13.870	0.26%	0.030µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[161.579µs; 161.695µs] or [-0.036%; +0.036%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.386µs	2.427µs ± 0.019µs	2.424µs ± 0.010µs	2.436µs	2.468µs	2.483µs	2.487µs	2.61%	0.802	1.466	0.76%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.425µs; 2.430µs] or [-0.106%; +0.106%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	185.147µs	185.695µs ± 0.263µs	185.665µs ± 0.167µs	185.855µs	186.079µs	186.270µs	187.486µs	0.98%	1.660	9.358	0.14%	0.019µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	5333727.318op/s	5385173.527op/s ± 7605.383op/s	5386057.813op/s ± 4836.616op/s	5390540.626op/s	5395432.714op/s	5398424.196op/s	5401121.003op/s	0.28%	-1.624	9.066	0.14%	537.782op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	17.774µs	17.852µs ± 0.043µs	17.846µs ± 0.030µs	17.878µs	17.926µs	17.956µs	18.030µs	1.04%	0.706	0.592	0.24%	0.003µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	55461591.915op/s	56016263.081op/s ± 135240.868op/s	56036351.115op/s ± 94544.280op/s	56121314.524op/s	56201379.462op/s	56249018.508op/s	56261822.666op/s	0.40%	-0.691	0.544	0.24%	9562.973op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	10.538µs	10.662µs ± 0.041µs	10.659µs ± 0.028µs	10.690µs	10.728µs	10.751µs	10.764µs	0.99%	-0.156	0.146	0.38%	0.003µs	1	200
normalization/normalize_name/normalize_name/good	throughput	92902266.815op/s	93795058.948op/s ± 361266.386op/s	93820598.668op/s ± 242464.243op/s	94000122.198op/s	94475732.007op/s	94641827.388op/s	94897395.785op/s	1.15%	0.180	0.165	0.38%	25545.391op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[185.659µs; 185.732µs] or [-0.020%; +0.020%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[5384119.494op/s; 5386227.560op/s] or [-0.020%; +0.020%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[17.846µs; 17.858µs] or [-0.034%; +0.034%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[55997519.998op/s; 56035006.165op/s] or [-0.033%; +0.033%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[10.656µs; 10.667µs] or [-0.053%; +0.053%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[93744990.901op/s; 93845126.994op/s] or [-0.053%; +0.053%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	494.384µs	495.412µs ± 0.507µs	495.392µs ± 0.336µs	495.716µs	496.130µs	496.837µs	498.319µs	0.59%	1.135	4.480	0.10%	0.036µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	2006747.801op/s	2018522.188op/s ± 2062.770op/s	2018602.544op/s ± 1366.834op/s	2020004.214op/s	2021382.976op/s	2022204.030op/s	2022718.727op/s	0.20%	-1.119	4.384	0.10%	145.860op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	369.191µs	370.069µs ± 0.422µs	370.038µs ± 0.242µs	370.288µs	370.726µs	370.978µs	372.905µs	0.77%	1.594	8.977	0.11%	0.030µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2681646.578op/s	2702202.209op/s ± 3075.262op/s	2702424.204op/s ± 1770.180op/s	2704088.031op/s	2706702.802op/s	2707786.112op/s	2708627.308op/s	0.23%	-1.566	8.755	0.11%	217.454op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	166.747µs	167.514µs ± 0.147µs	167.507µs ± 0.074µs	167.583µs	167.742µs	167.869µs	167.926µs	0.25%	-0.929	6.047	0.09%	0.010µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5955013.062op/s	5969637.680op/s ± 5226.803op/s	5969916.758op/s ± 2630.393op/s	5972382.730op/s	5976272.517op/s	5980981.760op/s	5997101.866op/s	0.46%	0.948	6.133	0.09%	369.591op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	36.502µs	36.859µs ± 0.226µs	36.811µs ± 0.094µs	36.897µs	37.422µs	37.528µs	37.554µs	2.02%	1.562	1.825	0.61%	0.016µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	26628235.812op/s	27131467.276op/s ± 164575.361op/s	27165436.758op/s ± 69423.724op/s	27244237.146op/s	27296733.779op/s	27355938.924op/s	27395416.414op/s	0.85%	-1.537	1.759	0.61%	11637.235op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	45.415µs	45.653µs ± 0.095µs	45.657µs ± 0.065µs	45.721µs	45.801µs	45.846µs	45.924µs	0.58%	-0.119	-0.280	0.21%	0.007µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	21775085.624op/s	21904655.804op/s ± 45727.269op/s	21902414.527op/s ± 31099.996op/s	21936038.169op/s	21979527.612op/s	22013521.812op/s	22019011.214op/s	0.53%	0.129	-0.280	0.21%	3233.406op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[495.342µs; 495.483µs] or [-0.014%; +0.014%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[2018236.308op/s; 2018808.068op/s] or [-0.014%; +0.014%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[370.011µs; 370.127µs] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2701776.007op/s; 2702628.411op/s] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[167.494µs; 167.535µs] or [-0.012%; +0.012%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5968913.295op/s; 5970362.065op/s] or [-0.012%; +0.012%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[36.828µs; 36.890µs] or [-0.085%; +0.085%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[27108658.714op/s; 27154275.838op/s] or [-0.084%; +0.084%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[45.639µs; 45.666µs] or [-0.029%; +0.029%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[21898318.444op/s; 21910993.163op/s] or [-0.029%; +0.029%]	None	None	None

Group 13

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	33.293µs	34.032µs ± 1.309µs	33.419µs ± 0.071µs	33.556µs	36.853µs	36.922µs	37.397µs	11.90%	1.689	0.902	3.84%	0.093µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[33.850µs; 34.213µs] or [-0.533%; +0.533%]	None	None	None

Group 14

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.193µs	3.198µs ± 1.427µs	2.995µs ± 0.029µs	3.020µs	3.642µs	13.786µs	14.820µs	394.84%	7.343	55.126	44.50%	0.101µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[3.001µs; 3.396µs] or [-6.183%; +6.183%]	None	None	None

Group 15

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	9b2bbe4	1758747421	gyuheon/prof-12432-test

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
ip_address/quantize_peer_ip_address_benchmark	execution_time	5.021µs	5.089µs ± 0.037µs	5.100µs ± 0.021µs	5.117µs	5.147µs	5.149µs	5.153µs	1.04%	-0.256	-1.151	0.73%	0.003µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark	execution_time	[5.084µs; 5.095µs] or [-0.102%; +0.102%]	None	None	None

Baseline

Omitted due to size.

[datadog-datadog-prod-us1]

⚠️ Tests

⚠️ Warnings

🧪 4 Tests failed

crash_info::tests::test_schema_matches_rfc from datadog-crashtracker (Datadog) (✨ Fix with BitsAI)

assertion \`left == right\` failed
stack backtrace:
   0:        0x10efd85be - std::backtrace_rs::backtrace::libunwind::trace::hdeb3d7f163c6eb98
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library/std/src/../../backtrace/src/backtrace/libunwind.rs:117:9
   1:        0x10efd85be - std::backtrace_rs::backtrace::trace_unsynchronized::h4cc326492c59f81f
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library/std/src/../../backtrace/src/backtrace/mod.rs:66:14
   2:        0x10efd85be - std::sys::backtrace::_print_fmt::hf35a3d8f5f170915
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library/std/src/sys/backtrace.rs:66:9
   3:        0x10efd85be - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h9d47c6f0aecc4f98
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library/std/src/sys/backtrace.rs:39:26
...

crash_info::tests::test_schema_matches_rfc from datadog-crashtracker (Datadog) (✨ Fix with BitsAI)

assertion \`left == right\` failed
stack backtrace:
   0:     0x561d4f978b6a - std::backtrace_rs::backtrace::libunwind::trace::h886f3b0575353f6e
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
   1:     0x561d4f978b6a - std::backtrace_rs::backtrace::trace_unsynchronized::h652d1041ec67eb09
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2:     0x561d4f978b6a - std::sys::backtrace::_print_fmt::hd0317245a04c3039
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/sys/backtrace.rs:66:9
   3:     0x561d4f978b6a - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h14b23c1989cbd5c2
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/sys/backtrace.rs:39:26
...

crash_info::tests::test_schema_matches_rfc from datadog-crashtracker (Datadog) (✨ Fix with BitsAI)

assertion \`left == right\` failed
stack backtrace:
   0:     0x7ff7c0325c62 - std::backtrace_rs::backtrace::win64::trace
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library\std\src\..\..\backtrace\src\backtrace\win64.rs:85
   1:     0x7ff7c0325c62 - std::backtrace_rs::backtrace::trace_unsynchronized
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library\std\src\..\..\backtrace\src\backtrace\mod.rs:66
   2:     0x7ff7c0325c62 - std::sys::backtrace::_print_fmt
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library\std\src\sys\backtrace.rs:66
   3:     0x7ff7c0325c62 - std::sys::backtrace::impl$0::print::impl$0::fmt
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library\std\src\sys\backtrace.rs:39
...

❄️ Known flaky: test_ddog_sidecar_register_app from datadog-sidecar-ffi::sidecar (Datadog) (✨ Fix with BitsAI)

thread 'test_ddog_sidecar_register_app' panicked at D:\a\libdatadog\libdatadog\ddcommon-ffi\src\option.rs:34:32

thread 'test_ddog_sidecar_register_app' panicked at D:\a\libdatadog\libdatadog\ddcommon-ffi\src\option.rs:34:32:
Called ffi::Option::unwrap_none but option was Some(_)
stack backtrace:
   0:     0x7ff6b827d8b2 - std::backtrace_rs::backtrace::win64::trace
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library\std\src\..\..\backtrace\src\backtrace\win64.rs:85
   1:     0x7ff6b827d8b2 - std::backtrace_rs::backtrace::trace_unsynchronized
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library\std\src\..\..\backtrace\src\backtrace\mod.rs:66
   2:     0x7ff6b827d8b2 - std::sys::backtrace::_print_fmt
...

View all

ℹ️ Info

❄️ No new flaky tests detected

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 9b2bbe4 | Docs | Was this helpful? Give us feedback!}