[Perf] Windows/arm64: 108 Improvements on 8/17/2022 8:19:48 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Memory.ReadOnlySpan

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IndexOfString - Duration of single invocation	24.04 ns	22.35 ns	0.93	0.01	False
IndexOfString - Duration of single invocation	25.87 ns	20.58 ns	0.80	0.01	False
IndexOfString - Duration of single invocation	16.26 ns	12.03 ns	0.74	0.03	False
IndexOfString - Duration of single invocation	17.27 ns	11.59 ns	0.67	0.01	False
IndexOfString - Duration of single invocation	18.50 ns	13.76 ns	0.74	0.02	False
IndexOfString - Duration of single invocation	67.69 ns	58.83 ns	0.87	0.01	False
IndexOfString - Duration of single invocation	18.16 ns	15.68 ns	0.86	0.01	False
IndexOfString - Duration of single invocation	33.74 ns	26.23 ns	0.78	0.03	False
IndexOfString - Duration of single invocation	67.70 ns	58.76 ns	0.87	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.ReadOnlySpan*'

Payloads

Baseline
Compare

Histogram

System.Memory.ReadOnlySpan.IndexOfString(input: "More Test's", value: "Tests", comparisonType: OrdinalIgnoreCase)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 31.09374104131751 (T) = (0 -22.407729448693846) / Math.Sqrt((1.0694174164541863 / (299)) + (0.002664102257773753 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.0774726268671082 = (24.289500887759534 - 22.407729448693846) / 24.289500887759534 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "x", comparisonType: OrdinalIgnoreCase)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.577569989703193 < 24.57323402699755.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/13/2022 3:46:07 PM, 8/17/2022 10:14:53 AM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 92.1397908046978 (T) = (0 -20.596215167560057) / Math.Sqrt((3.456874360442512 / (299)) + (0.0020442965888519764 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.32539563551308714 = (30.530806279655515 - 20.596215167560057) / 30.530806279655515 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello Worldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylong!xyz", value: "w", comparisonType: OrdinalIgnoreCase)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.027728086458927 < 15.462580565490073.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 44.81752576350333 (T) = (0 -12.028407510954441) / Math.Sqrt((3.0015019454526146 / (299)) + (0.0015938298509142002 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.27233993352869657 = (16.530256455166903 - 12.028407510954441) / 16.530256455166903 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello Worldbbbbbbbbbbbbbbcbbbbbbbbbbbbbbbbbbba!", value: "y", comparisonType: Ordinal)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.593879425477311 < 16.412428553611466.
IsChangePoint: Marked as a change because one of 8/17/2022 10:14:53 AM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 142.31101592149867 (T) = (0 -11.615840916997533) / Math.Sqrt((0.5096425029666476 / (299)) + (0.0011322195351762992 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.3381998207111052 = (17.551885418766084 - 11.615840916997533) / 17.551885418766084 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySpan.IndexOfString(input: "だだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだすだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだ", value: "す", comparisonType: Ordinal)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.760989951532185 < 17.576335967018.
IsChangePoint: Marked as a change because one of 5/31/2022 5:02:26 PM, 6/6/2022 8:15:49 PM, 8/5/2022 6:57:51 AM, 8/17/2022 10:14:53 AM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 50.97311927345418 (T) = (0 -13.691869663712316) / Math.Sqrt((1.1936072375916171 / (299)) + (0.00254496471830994 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.19195259432806405 = (16.94438911331789 - 13.691869663712316) / 16.94438911331789 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySpan.IndexOfString(input: "だだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだxだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだだ", value: "x", comparisonType: Ordinal)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 58.82849256843457 < 64.30737534098908.
IsChangePoint: Marked as a change because one of 5/31/2022 5:02:26 PM, 6/6/2022 8:15:49 PM, 8/17/2022 10:14:53 AM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 23.16214979599196 (T) = (0 -58.7771245163856) / Math.Sqrt((41.795293564982394 / (299)) + (0.0011748272199045542 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.12842779416281028 = (67.4380437131163 - 58.7771245163856) / 67.4380437131163 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySpan.IndexOfString(input: "StrIng", value: "string", comparisonType: OrdinalIgnoreCase)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.684394347779676 < 17.3083747201366.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 44.760015801230885 (T) = (0 -15.666270071515667) / Math.Sqrt((1.1580826273806937 / (299)) + (0.0002898708614281951 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.15112199812009108 = (18.455266877951185 - 15.666270071515667) / 18.455266877951185 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySpan.IndexOfString(input: "Hello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello WorldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylongHello Worldbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbareallyreallylong!xyz", value: "~", comparisonType: Ordinal)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 26.22601525583158 < 32.04796140441524.
IsChangePoint: Marked as a change because one of 5/31/2022 5:02:26 PM, 6/6/2022 8:15:49 PM, 8/17/2022 10:14:53 AM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 40.76126589952397 (T) = (0 -26.307180473769765) / Math.Sqrt((7.810436262209558 / (299)) + (0.00852816508147894 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.20108518672957512 = (32.92864274988107 - 26.307180473769765) / 32.92864274988107 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "X", comparisonType: Ordinal)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 58.755255910213684 < 64.3337314385815.
IsChangePoint: Marked as a change because one of 5/31/2022 5:02:26 PM, 6/6/2022 8:15:49 PM, 8/17/2022 10:14:53 AM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 23.435885225969955 (T) = (0 -58.77370805828662) / Math.Sqrt((39.757046642217425 / (299)) + (0.0015798400622225681 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.12696448530022836 = (67.32109641438622 - 58.77370805828662) / 67.32109641438622 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.IO.Tests.Perf_FileStream

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OpenClose - Duration of single invocation	22.28 μs	17.68 μs	0.79	0.55	False
Read - Duration of single invocation	4.35 ms	3.84 ms	0.88	0.04	False
Read_NoBuffering - Duration of single invocation	1.15 ms	1.06 ms	0.92	0.03	False
ReadAsync_NoBuffering - Duration of single invocation	49.78 ms	43.46 ms	0.87	0.59	False
Read - Duration of single invocation	4.19 ms	3.66 ms	0.87	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_FileStream*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.Perf_FileStream.OpenClose(fileSize: 1024, options: None)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 17.683044814754897 < 20.158349408462072.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 6.626061779384222 (T) = (0 -19581.44745253141) / Math.Sqrt((2940799.1812381214 / (299)) + (1670919.113722582 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.07870495072852496 = (21254.263189643396 - 19581.44745253141) / 21254.263189643396 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_FileStream.Read(fileSize: 1048576, userBufferSize: 512, options: Asynchronous)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.8375446875 < 4.089969291666666.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 11.770764411986075 (T) = (0 -4090985.525793142) / Math.Sqrt((4627678979.56503 / (299)) + (12946618486.840754 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.05649623277796258 = (4335950.388240897 - 4090985.525793142) / 4335950.388240897 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_FileStream.Read_NoBuffering(fileSize: 1048576, userBufferSize: 16384, options: Asynchronous)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0609505952380953 < 1.097761110859007.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 10.03913948948346 (T) = (0 -1082602.5629225324) / Math.Sqrt((270986985.9634675 / (299)) + (1234650932.0172281 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.05587702267286243 = (1146675.368485828 - 1082602.5629225324) / 1146675.368485828 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_FileStream.ReadAsync_NoBuffering(fileSize: 104857600, userBufferSize: 16384, options: None)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 43.46163035714286 < 46.984471218749995.
IsChangePoint: Marked as a change because one of 6/23/2022 8:35:19 AM, 6/25/2022 6:06:34 PM, 8/17/2022 2:33:27 AM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 5.923892798137265 (T) = (0 -44964218.13543107) / Math.Sqrt((21632223299879.67 / (299)) + (12630237729605.348 / (33))) is greater than 1.9671786747533526 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (33) - 2, .975) and 0.08162195061166311 = (48960466.95081441 - 44964218.13543107) / 48960466.95081441 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_FileStream.Read(fileSize: 1048576, userBufferSize: 4096, options: Asynchronous)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.6557917410714285 < 4.0004950260416665.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 14.150266202163717 (T) = (0 -3855213.8328299173) / Math.Sqrt((9052525960.932926 / (299)) + (13634575778.331064 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.07371507893545842 = (4162017.2639745413 - 3855213.8328299173) / 4162017.2639745413 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CtorInvoke - Duration of single invocation	398.70 μs	349.73 μs	0.88	0.03	False
OneNodeBacktracking - Duration of single invocation	121.36 ns	91.86 ns	0.76	0.04	False
CtorInvoke - Duration of single invocation	379.40 μs	333.83 μs	0.88	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.CtorInvoke(Options: IgnoreCase, Compiled)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 349.7260813492063 < 378.19247776604726.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 10.012718575252148 (T) = (0 -346793.8936664665) / Math.Sqrt((416051750.1085539 / (40)) + (9569142.380508494 / (31))) is greater than 1.9949454151066477 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (31) - 2, .975) and 0.08633044248490207 = (379561.61591904185 - 346793.8936664665) / 379561.61591904185 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: Compiled)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 91.86429168827931 < 114.98668735247443.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 8/17/2022 10:14:53 AM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 19.56516086955591 (T) = (0 -92.43343314122248) / Math.Sqrt((666.3199971647056 / (299)) + (0.8982783100310501 / (32))) is greater than 1.9672006833568965 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (32) - 2, .975) and 0.24125411286484882 = (121.82396597921569 - 92.43343314122248) / 121.82396597921569 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.CtorInvoke(Options: Compiled)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 5/24/2022 3:42:52 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 80.20265277110842 (T) = (0 -332799.3104598883) / Math.Sqrt((43790630.47062601 / (299)) + (6306904.554792458 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12476841974686655 = (380241.43320289755 - 332799.3104598883) / 380241.43320289755 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Reflection.Attributes

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IsDefinedClassMissInherit - Duration of single invocation	1.03 μs	847.22 ns	0.82	0.21	False
GetCustomAttributesMethodBaseHitInherit - Duration of single invocation	1.47 μs	1.11 μs	0.75	0.20	False
GetCustomAttributesMethodOverrideHitInherit - Duration of single invocation	2.46 μs	1.85 μs	0.75	0.21	False
GetCustomAttributesMethodOverrideHit - Duration of single invocation	1.47 μs	998.00 ns	0.68	0.23	False
GetCustomAttributesMethodOverrideMissInherit - Duration of single invocation	1.48 μs	1.10 μs	0.74	0.27	False
GetCustomAttributesClassHit - Duration of single invocation	1.45 μs	1.04 μs	0.72	0.19	False
GetCustomAttributesMethodOverrideMiss - Duration of single invocation	1.36 μs	987.09 ns	0.72	0.21	False
IsDefinedMethodOverrideMissInherit - Duration of single invocation	657.99 ns	513.72 ns	0.78	0.23	False
IsDefinedMethodOverrideHit - Duration of single invocation	624.31 ns	508.42 ns	0.81	0.25	False
IsDefinedMethodOverrideMiss - Duration of single invocation	620.36 ns	515.55 ns	0.83	0.26	False
IsDefinedMethodBaseHitInherit - Duration of single invocation	624.09 ns	523.58 ns	0.84	0.25	False
IsDefinedMethodOverrideHitInherit - Duration of single invocation	626.30 ns	507.65 ns	0.81	0.28	False
GetCustomAttributesClassHitInherit - Duration of single invocation	1.57 μs	1.16 μs	0.74	0.18	False
IsDefinedClassHit - Duration of single invocation	613.64 ns	498.43 ns	0.81	0.29	False
IsDefinedMethodBaseHit - Duration of single invocation	619.82 ns	515.35 ns	0.83	0.26	False
GetCustomAttributesMethodBaseHit - Duration of single invocation	1.39 μs	1.03 μs	0.74	0.24	False
IsDefinedClassMiss - Duration of single invocation	122.21 ns	101.01 ns	0.83	0.18	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Reflection.Attributes*'

Payloads

Baseline
Compare

Histogram

System.Reflection.Attributes.IsDefinedClassMissInherit

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 847.222237388076 < 0.9936798645931761.
IsChangePoint: Marked as a change because one of 7/9/2022 7:52:53 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 62.456649162581755 (T) = (0 -829.721160749246) / Math.Sqrt((3707.5252184751325 / (299)) + (287.16798730921073 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.25945392168040016 = (1120.4180064419443 - 829.721160749246) / 1120.4180064419443 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodBaseHitInherit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.109794984408103 < 1.3944965570249606.
IsChangePoint: Marked as a change because one of 7/9/2022 5:50:00 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 35.864145782668764 (T) = (0 -1122.1620479563499) / Math.Sqrt((9073.945591025573 / (299)) + (3919.3163759134422 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.2858018773454755 = (1571.2195430947215 - 1122.1620479563499) / 1571.2195430947215 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodOverrideHitInherit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.8466539805710225 < 2.2753843293425984.
IsChangePoint: Marked as a change because one of 7/10/2022 8:13:50 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 45.6432912444276 (T) = (0 -1877.3851531144044) / Math.Sqrt((18898.488290215184 / (299)) + (5451.879527778591 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.27321043179696464 = (2583.1206655265855 - 1877.3851531144044) / 2583.1206655265855 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodOverrideHit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 998.0045915439066 < 1.3338855993849525.
IsChangePoint: Marked as a change because one of 7/13/2022 12:52:03 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 59.49524028812956 (T) = (0 -1046.7785027324373) / Math.Sqrt((9663.670850172039 / (299)) + (999.2865971485121 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.31349773890534843 = (1524.7997888066864 - 1046.7785027324373) / 1524.7997888066864 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodOverrideMissInherit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.098851094166122 < 1.3835353561799248.
IsChangePoint: Marked as a change because one of 7/9/2022 5:50:00 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 35.76818561674475 (T) = (0 -1118.3011947358966) / Math.Sqrt((9637.615054000984 / (299)) + (3998.852698990838 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.2888250733096662 = (1572.469940609756 - 1118.3011947358966) / 1572.469940609756 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesClassHit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0435566164707686 < 1.2813341074260727.
IsChangePoint: Marked as a change because one of 7/12/2022 10:14:57 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 61.001695099361704 (T) = (0 -1011.0160099471597) / Math.Sqrt((8446.967490933404 / (299)) + (1074.7588142369739 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.32368799317352515 = (1494.8958465061846 - 1011.0160099471597) / 1494.8958465061846 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodOverrideMiss

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 987.0944771117854 < 1.3374129044949425.
IsChangePoint: Marked as a change because one of 7/13/2022 5:51:45 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 60.066618238499906 (T) = (0 -1035.2346253585777) / Math.Sqrt((8742.703500067051 / (299)) + (1027.4390816305036 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.3142589691540174 = (1509.6582803007034 - 1035.2346253585777) / 1509.6582803007034 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.IsDefinedMethodOverrideMissInherit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 513.71662624719 < 576.4413096111265.
IsChangePoint: Marked as a change because one of 6/21/2022 11:38:18 AM, 7/7/2022 7:47:15 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 34.909353159939656 (T) = (0 -507.24961017882646) / Math.Sqrt((1661.4559924851465 / (299)) + (304.7909176122903 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.21258181905143214 = (644.1934190137257 - 507.24961017882646) / 644.1934190137257 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.IsDefinedMethodOverrideHit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 508.4190183746049 < 579.6730266505958.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/24/2022 5:32:42 PM, 7/10/2022 9:08:48 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 38.32596670231935 (T) = (0 -507.82822807009995) / Math.Sqrt((1613.4997057165995 / (299)) + (243.07120054361104 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.21543075415577126 = (647.2701176601129 - 507.82822807009995) / 647.2701176601129 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.IsDefinedMethodOverrideMiss

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 515.5498273047575 < 569.0011839686498.
IsChangePoint: Marked as a change because one of 6/24/2022 5:32:42 PM, 7/7/2022 7:47:15 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 35.29184239524407 (T) = (0 -506.7836082330374) / Math.Sqrt((1603.8827314940295 / (299)) + (306.98294222991825 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.21389738451205256 = (644.6786949289923 - 506.7836082330374) / 644.6786949289923 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.IsDefinedMethodBaseHitInherit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 523.5829574126 < 574.804605180524.
IsChangePoint: Marked as a change because one of 6/24/2022 5:32:42 PM, 7/7/2022 7:47:15 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 35.71309305772541 (T) = (0 -507.1112618609973) / Math.Sqrt((1656.7289898410957 / (299)) + (293.43666744785446 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.2143387433190097 = (645.457896197247 - 507.1112618609973) / 645.457896197247 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.IsDefinedMethodOverrideHitInherit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 507.6485465593694 < 581.5489099321355.
IsChangePoint: Marked as a change because one of 6/24/2022 3:13:27 AM, 7/7/2022 7:47:15 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 37.987156028523486 (T) = (0 -506.92178668098376) / Math.Sqrt((1725.6008764346975 / (299)) + (247.3449801110483 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.2174506288824575 = (647.7824983196386 - 506.92178668098376) / 647.7824983196386 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesClassHitInherit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1645927474668296 < 1.4716442636428948.
IsChangePoint: Marked as a change because one of 7/16/2022 12:42:08 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 63.426613135249596 (T) = (0 -1177.435580300283) / Math.Sqrt((8733.24671033024 / (299)) + (996.6844817641024 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.2967469058469231 = (1674.2700317845895 - 1177.435580300283) / 1674.2700317845895 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.IsDefinedClassHit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 498.4329255834697 < 583.266297007757.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/22/2022 11:10:17 PM, 7/9/2022 5:50:00 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 42.685904884345625 (T) = (0 -483.3439607470581) / Math.Sqrt((1633.0388004624867 / (299)) + (119.64456087270287 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.21236711028643745 = (613.6665533645188 - 483.3439607470581) / 613.6665533645188 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.IsDefinedMethodBaseHit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 515.3494977976509 < 581.8735713305838.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/21/2022 3:41:14 AM, 7/11/2022 1:18:03 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 34.91596309369531 (T) = (0 -506.92291506545797) / Math.Sqrt((1571.2945150435216 / (299)) + (319.3632669009946 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.21363487634625672 = (644.6406380665849 - 506.92291506545797) / 644.6406380665849 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodBaseHit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0291740953823576 < 1.2881184282644291.
IsChangePoint: Marked as a change because one of 7/13/2022 11:09:36 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 46.58603125581081 (T) = (0 -1048.2838618883686) / Math.Sqrt((9439.517394776974 / (299)) + (2073.550650382411 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.30602084030770654 = (1510.5408386516563 - 1048.2838618883686) / 1510.5408386516563 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.IsDefinedClassMiss

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 101.00635488842117 < 115.5227750561896.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 34.352861548989424 (T) = (0 -100.93139712366828) / Math.Sqrt((20.159048085631735 / (299)) + (7.4117695716611385 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.1585566566056298 = (119.95031859960112 - 100.93139712366828) / 119.95031859960112 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Threading.Tests.Perf_Monitor

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
EnterExit - Duration of single invocation	16.79 ns	13.64 ns	0.81	0.12	False
TryEnterExit - Duration of single invocation	18.09 ns	16.09 ns	0.89	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_Monitor*'

Payloads

Baseline
Compare

Histogram

System.Threading.Tests.Perf_Monitor.EnterExit

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.641377863015565 < 15.304733891479538.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 34.265988042167 (T) = (0 -13.690937301941391) / Math.Sqrt((2.877307103978582 / (299)) + (0.04984340077342347 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.20963586844697635 = (17.32231607605905 - 13.690937301941391) / 17.32231607605905 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Threading.Tests.Perf_Monitor.TryEnterExit

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.090342512036628 < 17.407966340250148.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 36.95586941345959 (T) = (0 -16.242934463357635) / Math.Sqrt((1.1632848347464433 / (299)) + (0.0550816715500526 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.14623453268910325 = (19.025054403427642 - 16.242934463357635) / 19.025054403427642 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.IO.Tests.Perf_RandomAccess

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadScatter - Duration of single invocation	4.03 ms	3.72 ms	0.92	0.10	False
Read - Duration of single invocation	4.19 ms	3.74 ms	0.89	0.17	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_RandomAccess*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.Perf_RandomAccess.ReadScatter(fileSize: 1048576, buffersSize: 16384, options: Asynchronous)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.7156553125 < 3.8617711770833334.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 20.635371687656797 (T) = (0 -3805867.4509021924) / Math.Sqrt((11304287972.210745 / (299)) + (5168009837.611017 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.07195982488135372 = (4100972.7304269206 - 3805867.4509021924) / 4100972.7304269206 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_RandomAccess.Read(fileSize: 1048576, bufferSize: 4096, options: Asynchronous)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.736566875 < 3.9166160625.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 19.20319750653009 (T) = (0 -3748932.1833389397) / Math.Sqrt((12051824981.20894 / (299)) + (7062066109.260912 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.07738348826487684 = (4063369.9220150444 - 3748932.1833389397) / 4063369.9220150444 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.IO.Pipelines.Tests.Perf_Pipe

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadAsync - Duration of single invocation	3.51 ms	3.02 ms	0.86	0.44	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Pipelines.Tests.Perf_Pipe*'

Payloads

Baseline
Compare

Histogram

System.IO.Pipelines.Tests.Perf_Pipe.ReadAsync

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.018002570281124 < 3.4057457777777778.
IsChangePoint: Marked as a change because one of 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 6.987253343913592 (T) = (0 -3097084.7273265095) / Math.Sqrt((73961198862.2013 / (299)) + (61360188381.76661 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.09621676703435439 = (3426800.381285935 - 3097084.7273265095) / 3426800.381285935 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Cache

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IsMatch_Multithreading - Duration of single invocation	27.86 ms	24.67 ms	0.89	0.34	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Cache*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch_Multithreading(total: 40000, unique: 7, cacheSize: 0)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 24.671773529411762 < 26.23716138888889.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 8.852947251734752 (T) = (0 -25680079.755927872) / Math.Sqrt((1071807466556.6019 / (40)) + (1008640367662.1978 / (31))) is greater than 1.9949454151066477 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (31) - 2, .975) and 0.07746717691605813 = (27836494.39169193 - 25680079.755927872) / 27836494.39169193 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
HeapSort - Duration of single invocation	8.29 μs	7.49 μs	0.90	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.HeapSort(Size: 100)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.489371810207336 < 7.855232707894215.
IsChangePoint: Marked as a change because one of 6/27/2022 8:54:23 AM, 7/6/2022 11:58:32 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 34.30573190000896 (T) = (0 -7505.812450963691) / Math.Sqrt((170052.05032538142 / (299)) + (329.37274224850864 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.0991095590144913 = (8331.548554064884 - 7505.812450963691) / 8331.548554064884 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Collections.CopyTo<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ImmutableArray - Duration of single invocation	564.00 ns	518.71 ns	0.92	0.01	False
Memory - Duration of single invocation	596.86 ns	546.14 ns	0.92	0.02	False
ReadOnlyMemory - Duration of single invocation	577.92 ns	537.16 ns	0.93	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CopyTo<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.CopyTo<String>.ImmutableArray(Size: 2048)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 518.7115423201685 < 535.6180323661857.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 34.11527927719615 (T) = (0 -520.040926360944) / Math.Sqrt((9.55800225336942 / (299)) + (44.12314776166792 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.07333472262619947 = (561.1960856402831 - 520.040926360944) / 561.1960856402831 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CopyTo&lt;String&gt;.Memory(Size: 2048)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 546.13661753524 < 562.1801600064827.
IsChangePoint: Marked as a change because one of 8/18/2022 12:56:07 AM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 13.599994777545314 (T) = (0 -555.2194155546059) / Math.Sqrt((27.27132644480765 / (299)) + (200.47624843959719 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.06087990397792489 = (591.2123677327365 - 555.2194155546059) / 591.2123677327365 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CopyTo&lt;String&gt;.ReadOnlyMemory(Size: 2048)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 537.1611065541466 < 549.9685480999909.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 11.467756619157663 (T) = (0 -546.7338580362249) / Math.Sqrt((21.850399041946527 / (299)) + (240.96570544144168 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.055492783720695625 = (578.8561999451657 - 546.7338580362249) / 578.8561999451657 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Diagnostics.Perf_Process

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetCurrentProcess - Duration of single invocation	144.13 ns	123.63 ns	0.86	0.15	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Diagnostics.Perf_Process*'

Payloads

Baseline
Compare

Histogram

System.Diagnostics.Perf_Process.GetCurrentProcess

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 123.62821590692118 < 128.2400898602221.
IsChangePoint: Marked as a change because one of 6/20/2022 12:28:47 PM, 8/10/2022 11:28:06 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 19.565865472020004 (T) = (0 -124.87044913188143) / Math.Sqrt((17.68527289707541 / (299)) + (2.043003562480597 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.05250041258603824 = (131.78944961094282 - 124.87044913188143) / 131.78944961094282 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in Microsoft.Extensions.DependencyInjection.TimeToFirstService

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Singleton - Duration of single invocation	3.72 μs	3.42 μs	0.92	0.19	False
Singleton - Duration of single invocation	3.70 μs	3.41 μs	0.92	0.19	False
Singleton - Duration of single invocation	3.68 μs	3.40 μs	0.92	0.17	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.DependencyInjection.TimeToFirstService*'

Payloads

Baseline
Compare

Histogram

Microsoft.Extensions.DependencyInjection.TimeToFirstService.Singleton(Mode: "ILEmit")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.419577777567183 < 3.519150182275385.
IsChangePoint: Marked as a change because one of 5/24/2022 3:42:52 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 10.481912849926937 (T) = (0 -3458.7167977031186) / Math.Sqrt((28699.657739785725 / (299)) + (13991.406752743349 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.06620605661876554 = (3703.9400632426773 - 3458.7167977031186) / 3703.9400632426773 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Microsoft.Extensions.DependencyInjection.TimeToFirstService.Singleton(Mode: "Expressions")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.4056061754065037 < 3.5308535378135866.
IsChangePoint: Marked as a change because one of 5/24/2022 3:42:52 PM, 8/16/2022 9:24:43 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 8.060653660660462 (T) = (0 -3479.3648624172847) / Math.Sqrt((31074.419199829346 / (299)) + (23643.073549108234 / (35))) is greater than 1.9671350567190904 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (35) - 2, .975) and 0.06074970141072071 = (3704.4064480396414 - 3479.3648624172847) / 3704.4064480396414 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Microsoft.Extensions.DependencyInjection.TimeToFirstService.Singleton(Mode: "Runtime")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.3976317954389135 < 3.5021150900497044.
IsChangePoint: Marked as a change because one of 5/23/2022 7:50:08 PM, 8/16/2022 9:24:43 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 6.220859887781341 (T) = (0 -3502.5584972269567) / Math.Sqrt((25295.718139071403 / (299)) + (29505.178163280947 / (35))) is greater than 1.9671350567190904 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (35) - 2, .975) and 0.05131775016637915 = (3692.024909121292 - 3502.5584972269567) / 3692.024909121292 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Text.Perf_Utf8Encoding

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetBytes - Duration of single invocation	228.73 μs	175.35 μs	0.77	0.00	False
GetByteCount - Duration of single invocation	40.08 μs	25.20 μs	0.63	0.00	False
GetByteCount - Duration of single invocation	86.71 μs	54.45 μs	0.63	0.00	False
GetByteCount - Duration of single invocation	34.19 μs	20.48 μs	0.60	0.00	False
GetBytes - Duration of single invocation	251.10 μs	206.16 μs	0.82	0.01	False
GetBytes - Duration of single invocation	196.17 μs	153.74 μs	0.78	0.00	False
GetBytes - Duration of single invocation	169.56 μs	129.17 μs	0.76	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Perf_Utf8Encoding*'

Payloads

Baseline
Compare

Histogram

System.Text.Perf_Utf8Encoding.GetBytes(Input: Chinese)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 175.35054166666666 < 217.21525796885783.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 634.9158681185395 (T) = (0 -176056.3843241577) / Math.Sqrt((450999.32221975015 / (299)) + (155524.19102503025 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.2255959126525036 = (227344.3376663847 - 176056.3843241577) / 227344.3376663847 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Perf_Utf8Encoding.GetByteCount(Input: Chinese)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 25.19817767042405 < 38.088471343160045.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 7865.679782380882 (T) = (0 -25187.27415962028) / Math.Sqrt((362.09171751037275 / (299)) + (73.93577404504154 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.3719374390323652 = (40103.12940929817 - 25187.27415962028) / 40103.12940929817 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Perf_Utf8Encoding.GetByteCount(Input: EnglishMostlyAscii)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 54.452919793621014 < 82.3725882915427.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 4352.876672795207 (T) = (0 -54482.12262726822) / Math.Sqrt((395.4668064948594 / (299)) + (1656.5812152279127 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.37155561491451056 = (86693.62623051653 - 54482.12262726822) / 86693.62623051653 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Perf_Utf8Encoding.GetByteCount(Input: Cyrillic)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.47967955957086 < 32.46926458690736.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 5833.234500786719 (T) = (0 -20490.135554518296) / Math.Sqrt((934.5684852453147 / (299)) + (74.37960584655953 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.4008964526017975 = (34201.32570321645 - 20490.135554518296) / 34201.32570321645 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Perf_Utf8Encoding.GetBytes(Input: Greek)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 206.16106359649123 < 238.72734746387871.
IsChangePoint: Marked as a change because one of 5/17/2022 8:30:53 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 179.24807850992383 (T) = (0 -204380.9601002058) / Math.Sqrt((364403.49843556894 / (299)) + (2005317.5718121931 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.18377546436788839 = (250397.96180829866 - 204380.9601002058) / 250397.96180829866 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Perf_Utf8Encoding.GetBytes(Input: EnglishMostlyAscii)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 153.74452793493634 < 186.1422586089595.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 459.8810004133114 (T) = (0 -153444.86639392268) / Math.Sqrt((437988.2544657672 / (299)) + (208365.33014783423 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.2133214000675397 = (195054.07469721 - 153444.86639392268) / 195054.07469721 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Perf_Utf8Encoding.GetBytes(Input: Cyrillic)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 129.17436033246415 < 160.0269118977461.
IsChangePoint: Marked as a change because one of 5/17/2022 8:30:53 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 253.4945808734818 (T) = (0 -129417.86787163003) / Math.Sqrt((126839.70857181487 / (299)) + (692248.1591539911 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.2280783899443048 = (167656.74931978178 - 129417.86787163003) / 167656.74931978178 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Threading.Channels.Tests.UnboundedChannelPerfTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryWriteThenTryRead - Duration of single invocation	51.60 ns	48.56 ns	0.94	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.UnboundedChannelPerfTests*'

Payloads

Baseline
Compare

Histogram

System.Threading.Channels.Tests.UnboundedChannelPerfTests.TryWriteThenTryRead

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 48.56334988101144 < 49.15233406163359.
IsChangePoint: Marked as a change because one of 6/10/2022 9:37:39 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 23.420899945403587 (T) = (0 -48.7747076419387) / Math.Sqrt((5.620815430216202 / (299)) + (0.23448150872599555 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.07232665461428324 = (52.577459387559195 - 48.7747076419387) / 52.577459387559195 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Threading.Channels.Tests.BoundedChannelPerfTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteAsyncThenReadAsync - Duration of single invocation	95.09 ns	87.96 ns	0.93	0.01	False
TryWriteThenTryRead - Duration of single invocation	57.42 ns	49.65 ns	0.86	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.BoundedChannelPerfTests*'

Payloads

Baseline
Compare

Histogram

System.Threading.Channels.Tests.BoundedChannelPerfTests.WriteAsyncThenReadAsync

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 87.96465172341594 < 90.36808255749932.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 45.89619481049125 (T) = (0 -86.55004432296721) / Math.Sqrt((11.474872644703309 / (299)) + (0.6454365241497269 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.11427749348858166 = (97.71688501386348 - 86.55004432296721) / 97.71688501386348 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Threading.Channels.Tests.BoundedChannelPerfTests.TryWriteThenTryRead

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 49.65452388495962 < 54.595904526966464.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 42.24203393207827 (T) = (0 -49.49085959823546) / Math.Sqrt((7.602574268304376 / (299)) + (0.1620535937616118 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.13001061351336995 = (56.886739501615786 - 49.49085959823546) / 56.886739501615786 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Collections.Concurrent.Count<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	5.31 μs	4.75 μs	0.89	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.Count<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.Count<Int32>.Dictionary(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.748027945619334 < 5.0452077800770905.
IsChangePoint: Marked as a change because one of 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 30.634904997480554 (T) = (0 -4723.73159089059) / Math.Sqrt((221935.97627718173 / (299)) + (216.11613531176755 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.15075524725284442 = (5562.273509032772 - 4723.73159089059) / 5562.273509032772 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.IO.Tests.StreamReaderReadLineTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadLineAsync - Duration of single invocation	48.33 μs	42.95 μs	0.89	0.01	False
ReadLineAsync - Duration of single invocation	39.77 μs	34.03 μs	0.86	0.01	False
ReadLineAsync - Duration of single invocation	40.17 μs	34.15 μs	0.85	0.01	False
ReadLineAsync - Duration of single invocation	43.18 μs	37.00 μs	0.86	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StreamReaderReadLineTests*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 33, 128])

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 42.95099072253624 < 46.05989919164781.
IsChangePoint: Marked as a change because one of 6/7/2022 11:31:29 PM, 7/6/2022 11:58:32 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 19.37941666344921 (T) = (0 -43197.03056866778) / Math.Sqrt((6357218.770974216 / (299)) + (116962.36585007451 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.06627873600889844 = (46263.30387296337 - 43197.03056866778) / 46263.30387296337 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [   0, 1024])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 34.02741904245429 < 37.88404162535777.
IsChangePoint: Marked as a change because one of 6/7/2022 11:31:29 PM, 7/6/2022 11:58:32 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 23.83015383514079 (T) = (0 -34122.6622558437) / Math.Sqrt((6496091.199506392 / (299)) + (5851.086327611635 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.09369708762423351 = (37650.39457546832 - 34122.6622558437) / 37650.39457546832 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 129, 1024])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 34.14785652687 < 38.152080632028095.
IsChangePoint: Marked as a change because one of 6/7/2022 11:31:29 PM, 7/6/2022 11:58:32 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 22.796798046289023 (T) = (0 -34401.117990932165) / Math.Sqrt((6797419.76518169 / (299)) + (26537.026462062553 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.09237811694587858 = (37902.4774889444 - 34401.117990932165) / 37902.4774889444 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [1025, 2048])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 36.99865610328639 < 41.027105219591014.
IsChangePoint: Marked as a change because one of 6/7/2022 11:31:29 PM, 7/6/2022 11:58:32 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 24.120262176433695 (T) = (0 -37019.3166893998) / Math.Sqrt((7487752.305496958 / (299)) + (9915.052328787935 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.09400978895093953 = (40860.61442820066 - 37019.3166893998) / 40860.61442820066 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in Exceptions.Handling

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ThrowAndCatchDeepRecursive - Duration of single invocation	42.33 μs	36.22 μs	0.86	0.16	False
CatchAndThrowOtherDeep - Duration of single invocation	125.25 μs	100.55 μs	0.80	0.09	False
ThrowAndCatchDeep - Duration of single invocation	44.01 μs	35.71 μs	0.81	0.17	False
ThrowAndCatchWhenFinally - Duration of single invocation	8.86 μs	7.45 μs	0.84	0.21	False
MultipleNestedTryFinally - Duration of single invocation	9.37 μs	7.50 μs	0.80	0.18	False
ThrowAndCatchDeep - Duration of single invocation	23.35 μs	20.69 μs	0.89	0.20	False
ThrowAndCatch - Duration of single invocation	8.70 μs	7.32 μs	0.84	0.16	False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation	26.41 μs	22.17 μs	0.84	0.13	False
CatchAndRethrowDeep - Duration of single invocation	117.00 μs	96.60 μs	0.83	0.12	False
MultipleNestedTryCatch_LastCatches - Duration of single invocation	9.22 μs	7.49 μs	0.81	0.17	False
ThrowAndCatchFinally - Duration of single invocation	8.73 μs	7.51 μs	0.86	0.18	False
ThrowAndCatch - Duration of single invocation	25.93 μs	21.75 μs	0.84	0.14	False
ThrowAndCatchWhen - Duration of single invocation	8.74 μs	7.48 μs	0.86	0.22	False
TryAndFinallyDeep - Duration of single invocation	24.42 μs	21.03 μs	0.86	0.24	False
ThrowAndCatchDeepRecursive - Duration of single invocation	45.50 μs	39.45 μs	0.87	0.19	False
ThrowAndCatchDeep - Duration of single invocation	43.98 μs	38.10 μs	0.87	0.22	False
MultipleNestedTryCatch_FirstCatches - Duration of single invocation	8.67 μs	7.28 μs	0.84	0.16	False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation	8.96 μs	8.05 μs	0.90	0.20	False
TryAndFinallyDeep - Duration of single invocation	26.87 μs	24.51 μs	0.91	0.26	False
ThrowAndCatch - Duration of single invocation	28.89 μs	25.27 μs	0.87	0.18	False
TryAndCatchDeep_CaugtAtTheTop - Duration of single invocation	24.47 μs	23.04 μs	0.94	0.26	False
CatchAndThrowOtherDeep - Duration of single invocation	126.53 μs	104.64 μs	0.83	0.12	False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation	29.26 μs	25.61 μs	0.88	0.14	False
ThrowAndCatchDeepRecursive - Duration of single invocation	27.35 μs	24.63 μs	0.90	0.20	False
CatchAndRethrowDeep - Duration of single invocation	125.69 μs	106.27 μs	0.85	0.10	False
ThrowAndCatchDeepRecursive - Duration of single invocation	24.67 μs	21.46 μs	0.87	0.21	False
TryAndCatchDeep_CaugtAtTheTop - Duration of single invocation	29.61 μs	24.66 μs	0.83	0.26	False
ThrowAndCatchDeep - Duration of single invocation	27.34 μs	23.13 μs	0.85	0.21	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Exceptions.Handling*'

Payloads

Baseline
Compare

Histogram

Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: ReflectionSoftware)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 36.21572459584295 < 39.67187317151662.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 67.29748568191654 (T) = (0 -36133.59538299919) / Math.Sqrt((1229199.8355653118 / (299)) + (35784.012051517886 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.11905568091378671 = (41016.889036165056 - 36133.59538299919) / 41016.889036165056 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.CatchAndThrowOtherDeep(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 100.54847489316239 < 117.18931910854893.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 63.71743552673082 (T) = (0 -101557.57065615512) / Math.Sqrt((9225168.625121647 / (299)) + (2017260.0841463848 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.16270263439437596 = (121292.11774444996 - 101557.57065615512) / 121292.11774444996 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeep(kind: ReflectionSoftware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 35.7132089977221 < 38.33986976686923.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 51.20149622976965 (T) = (0 -34954.26164438262) / Math.Sqrt((1862754.699205273 / (299)) + (89925.02624263527 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12278416320217422 = (39846.820107556516 - 34954.26164438262) / 39846.820107556516 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchWhenFinally(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.45178741577622 < 8.319684160913202.
IsChangePoint: Marked as a change because one of 6/15/2022 7:24:26 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 47.49559321095017 (T) = (0 -7483.868153071333) / Math.Sqrt((92868.20887811501 / (299)) + (6586.1961569888535 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12674772177224194 = (8570.110081200866 - 7483.868153071333) / 8570.110081200866 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryFinally(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.496808034064879 < 8.316855857208175.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 48.711705142501565 (T) = (0 -7585.869162915324) / Math.Sqrt((73804.30686069746 / (299)) + (8312.698602090275 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12718836058144353 = (8691.30155959976 - 7585.869162915324) / 8691.30155959976 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeep(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.693990701327657 < 22.104374793853612.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 37.55656825900199 (T) = (0 -20298.191337749264) / Math.Sqrt((689721.4376365312 / (299)) + (52041.54945082451 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.10459061475335622 = (22669.174203661103 - 20298.191337749264) / 22669.174203661103 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.316546175373135 < 8.19615051717817.
IsChangePoint: Marked as a change because one of 6/15/2022 2:32:53 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 43.63948502316915 (T) = (0 -7370.813944584254) / Math.Sqrt((65767.75296092888 / (299)) + (11299.703002009184 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.1252121275436791 = (8425.830051676085 - 7370.813944584254) / 8425.830051676085 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: ReflectionSoftware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 22.17349164133738 < 24.920315300066186.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 61.11629142323106 (T) = (0 -22341.6572077222) / Math.Sqrt((512291.9213759188 / (299)) + (41133.65641382687 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.1310640349717895 = (25711.511672781166 - 22341.6572077222) / 25711.511672781166 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.CatchAndRethrowDeep(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 96.59983741181657 < 110.44484087947212.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 76.7871204026824 (T) = (0 -97224.77362594806) / Math.Sqrt((9331448.944150353 / (299)) + (792798.2862992923 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.15839114391912656 = (115522.51728753833 - 97224.77362594806) / 115522.51728753833 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryCatch_LastCatches(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.485869991809434 < 8.300798445289585.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 51.451254207615825 (T) = (0 -7578.96511084337) / Math.Sqrt((68248.18860141131 / (299)) + (7105.63143702588 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12679011801023707 = (8679.431219414695 - 7578.96511084337) / 8679.431219414695 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchFinally(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.512165422286448 < 8.199972132390819.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 39.69675757920821 (T) = (0 -7404.11204983634) / Math.Sqrt((65240.80303774186 / (299)) + (13700.728124245112 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12107562746091113 = (8424.060455220853 - 7404.11204983634) / 8424.060455220853 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch(kind: ReflectionSoftware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.753279556914492 < 24.608524735308027.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 61.788415707493904 (T) = (0 -22054.300626375225) / Math.Sqrt((461071.5756586797 / (299)) + (43682.09461541449 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.13209364625690478 = (25410.921963250672 - 22054.300626375225) / 25410.921963250672 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchWhen(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.483180434462717 < 8.250590210636057.
IsChangePoint: Marked as a change because one of 6/15/2022 9:01:28 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 57.96720878225541 (T) = (0 -7476.9002550061305) / Math.Sqrt((80049.78366614315 / (299)) + (2733.3130417332577 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12759681975043435 = (8570.464235202853 - 7476.9002550061305) / 8570.464235202853 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndFinallyDeep(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.028321524966263 < 23.16965264927077.
IsChangePoint: Marked as a change because one of 7/16/2022 2:59:06 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 51.6494890215069 (T) = (0 -20986.020654600074) / Math.Sqrt((756836.2170205842 / (299)) + (22988.464360289494 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12342022354524258 = (23940.799478030414 - 20986.020654600074) / 23940.799478030414 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: ReflectionHardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.44741601752678 < 43.20767510435301.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 31.66271919881187 (T) = (0 -40702.97030546835) / Math.Sqrt((2674908.219038743 / (299)) + (254807.83347978117 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.09249205435823805 = (44851.3652149728 - 40702.97030546835) / 44851.3652149728 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeep(kind: ReflectionHardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.09716354529617 < 41.963638506355935.
IsChangePoint: Marked as a change because one of 6/15/2022 9:01:28 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 26.91864192529552 (T) = (0 -39635.15024301535) / Math.Sqrt((2458900.0102281813 / (299)) + (353097.03138003306 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.08685506217131347 = (43405.10317810164 - 39635.15024301535) / 43405.10317810164 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryCatch_FirstCatches(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.277582404828226 < 8.120630812473433.
IsChangePoint: Marked as a change because one of 6/15/2022 9:01:28 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 49.499795746129955 (T) = (0 -7384.59440742501) / Math.Sqrt((62488.384074971495 / (299)) + (7544.542220626806 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12477819661894847 = (8437.397673250065 - 7384.59440742501) / 8437.397673250065 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 47.597631807418644 (T) = (0 -7652.82004005083) / Math.Sqrt((83575.79336291071 / (299)) + (7401.77305834655 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12403262077183054 = (8736.421265816847 - 7652.82004005083) / 8736.421265816847 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndFinallyDeep(kind: Hardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 24.513999470693115 < 25.779825639503343.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 15.723971191588229 (T) = (0 -25309.86417046705) / Math.Sqrt((1682070.9290603558 / (299)) + (236982.03071896094 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.0667870871765578 = (27121.21084339894 - 25309.86417046705) / 27121.21084339894 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch(kind: ReflectionHardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 25.27398819108964 < 28.150651518549083.
IsChangePoint: Marked as a change because one of 5/17/2022 10:55:34 AM, 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 19.934738761334994 (T) = (0 -26597.284072762443) / Math.Sqrt((1225605.489443177 / (299)) + (314351.73818369827 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.08209500584519827 = (28976.0751299245 - 26597.284072762443) / 28976.0751299245 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 7/21/2022 3:32:26 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 33.38128366823581 (T) = (0 -20975.008185288767) / Math.Sqrt((885853.6892098609 / (299)) + (159394.96560616454 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.1253181497082023 = (23980.15710317004 - 20975.008185288767) / 23980.15710317004 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.CatchAndThrowOtherDeep(kind: Hardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 104.63656388888889 < 120.59192557670029.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 68.43203974030199 (T) = (0 -106644.50088436111) / Math.Sqrt((12286180.432918757 / (299)) + (1134256.2758069085 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.15171155688079255 = (125717.26250592651 - 106644.50088436111) / 125717.26250592651 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: ReflectionHardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 25.613524673735725 < 28.57806770699271.
IsChangePoint: Marked as a change because one of 5/17/2022 8:30:53 PM, 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 19.64611447103313 (T) = (0 -26931.31192595183) / Math.Sqrt((1135237.3931785752 / (299)) + (321953.0520001725 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.07993076445191703 = (29270.96232047028 - 26931.31192595183) / 29270.96232047028 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: Hardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 24.63354752530934 < 25.98366137412766.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 14.05234774586798 (T) = (0 -25695.924488385404) / Math.Sqrt((1328963.1728468603 / (299)) + (200929.3247284024 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.054072769203221925 = (27164.800474917174 - 25695.924488385404) / 27164.800474917174 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.CatchAndRethrowDeep(kind: Hardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 106.26641483516482 < 117.04699818108972.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 58.19516594948946 (T) = (0 -107223.23086200737) / Math.Sqrt((9020346.797122473 / (299)) + (695337.3811309865 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.1106967985373932 = (120569.93687379171 - 107223.23086200737) / 120569.93687379171 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: Software)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.458855593607304 < 23.19612245001781.
IsChangePoint: Marked as a change because one of 7/20/2022 5:51:15 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 33.41920367915917 (T) = (0 -21469.905582261523) / Math.Sqrt((862249.4079142727 / (299)) + (103914.1683783765 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.10946262245599966 = (24108.932565495514 - 21469.905582261523) / 24108.932565495514 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Hardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 24.66091457023061 < 26.38692745291438.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 13.5946621290795 (T) = (0 -25493.182056551672) / Math.Sqrt((1900441.6226718135 / (299)) + (216364.04589790796 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.05800900370839817 = (27063.08463341196 - 25493.182056551672) / 27063.08463341196 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeep(kind: Hardware)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 23.13048497774481 < 25.22820607356558.
IsChangePoint: Marked as a change because one of 6/15/2022 1:30:25 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 12.762469314242082 (T) = (0 -24312.539348108257) / Math.Sqrt((1428087.3695882682 / (299)) + (244982.1870317762 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.055809019636953935 = (25749.599237603357 - 24312.539348108257) / 25749.599237603357 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Tests.Perf_DateTime

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetNow - Duration of single invocation	151.61 ns	135.18 ns	0.89	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTime*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_DateTime.GetNow

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 135.17872675036682 < 144.07405569326352.
IsChangePoint: Marked as a change because one of 7/31/2022 12:39:41 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 74.36702751442985 (T) = (0 -135.28834021633986) / Math.Sqrt((59.67765292516118 / (299)) + (0.20795183526022407 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.1997895493710247 = (169.06595022597062 - 135.28834021633986) / 169.06595022597062 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in Microsoft.AspNetCore.Server.Kestrel.Performance.PipeThroughputBenchmark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Parse_SequentialAsync - Duration of single invocation	797.89 ns	667.46 ns	0.84	0.14	False
Parse_SequentialAsync - Duration of single invocation	732.17 ns	666.25 ns	0.91	0.15	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.AspNetCore.Server.Kestrel.Performance.PipeThroughputBenchmark*'

Payloads

Baseline
Compare

Histogram

Microsoft.AspNetCore.Server.Kestrel.Performance.PipeThroughputBenchmark.Parse_SequentialAsync(Length: 4096, Chunks: 16)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 667.4581397394217 < 693.9115164620534.
IsChangePoint: Marked as a change because one of 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 15.579627106034682 (T) = (0 -672.1149200647765) / Math.Sqrt((949.4362555309036 / (299)) + (246.4341185816722 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.0717659274103876 = (724.0791303746179 - 672.1149200647765) / 724.0791303746179 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Microsoft.AspNetCore.Server.Kestrel.Performance.PipeThroughputBenchmark.Parse_SequentialAsync(Length: 128, Chunks: 16)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 666.2511676290761 < 695.6302883641248.
IsChangePoint: Marked as a change because one of 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 28.639342712217033 (T) = (0 -667.6367702217309) / Math.Sqrt((989.2216365798777 / (299)) + (19.342235538744124 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.07839613309246712 = (724.4292197492665 - 667.6367702217309) / 724.4292197492665 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Tests.Perf_Enum

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Parse - Duration of single invocation	113.77 ns	91.27 ns	0.80	0.18	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Enum*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Enum.Parse(text: "Red")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 91.26827537683648 < 108.43713707856197.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 3:55:24 AM, 7/14/2022 2:40:17 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 31.235520877227238 (T) = (0 -93.83018566891545) / Math.Sqrt((336.95537716709816 / (299)) + (11.098557750128226 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.2885909943524692 = (131.8934465603375 - 93.83018566891545) / 131.8934465603375 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Collections.CtorFromCollectionNonGeneric<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ArrayList - Duration of single invocation	17.76 μs	16.10 μs	0.91	0.14	False
Stack - Duration of single invocation	32.39 μs	27.02 μs	0.83	0.13	False
Queue - Duration of single invocation	32.57 μs	27.61 μs	0.85	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorFromCollectionNonGeneric<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.CtorFromCollectionNonGeneric<Int32>.ArrayList(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.100012490747595 < 16.862074017163504.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 26.880035958918178 (T) = (0 -16164.711245409815) / Math.Sqrt((1127473.5840641363 / (299)) + (33383.96712230097 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.10376532667515938 = (18036.24845872361 - 16164.711245409815) / 18036.24845872361 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollectionNonGeneric&lt;Int32&gt;.Stack(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 27.02067699368904 < 29.479662882031796.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 29.081990874809975 (T) = (0 -27331.626166592752) / Math.Sqrt((1437479.195045089 / (299)) + (361415.435786989 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12013540134203897 = (31063.44568048437 - 27331.626166592752) / 31063.44568048437 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollectionNonGeneric&lt;Int32&gt;.Queue(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 27.60824823943662 < 30.383922180652476.
IsChangePoint: Marked as a change because one of 6/24/2022 10:40:04 AM, 6/26/2022 6:49:05 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 29.530879579885717 (T) = (0 -27836.9561596554) / Math.Sqrt((1832869.6757510682 / (299)) + (283502.328626085 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.11591570187588486 = (31486.76683741692 - 27836.9561596554) / 31486.76683741692 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Threading.Tests.Perf_SemaphoreSlim

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReleaseWaitAsync - Duration of single invocation	49.02 ns	44.77 ns	0.91	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_SemaphoreSlim*'

Payloads

Baseline
Compare

Histogram

System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWaitAsync

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 44.772538418268034 < 46.6786109950031.
IsChangePoint: Marked as a change because one of 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 25.493370429811243 (T) = (0 -44.628021350152395) / Math.Sqrt((21.11912630507004 / (299)) + (0.7589459627991353 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.14978611049238272 = (52.490346136308986 - 44.628021350152395) / 52.490346136308986 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryWriteThenTryRead - Duration of single invocation	54.80 ns	50.75 ns	0.93	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests*'

Payloads

Baseline
Compare

Histogram

System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.TryWriteThenTryRead

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 50.75391605178731 < 52.033050246702075.
IsChangePoint: Marked as a change because one of 6/20/2022 7:45:04 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 27.857573120075287 (T) = (0 -50.856291494292) / Math.Sqrt((2.4965973495485545 / (299)) + (0.7046202844709916 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.08806430124879724 = (55.76740943899245 - 50.856291494292) / 55.76740943899245 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in MicroBenchmarks.Serializers.Json_FromStream<CollectionsOfPrimitives>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
DataContractJsonSerializer_ - Duration of single invocation	5.49 ms	4.74 ms	0.86	0.37	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'MicroBenchmarks.Serializers.Json_FromStream<CollectionsOfPrimitives>*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_FromStream<CollectionsOfPrimitives>.DataContractJsonSerializer_

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.739496666666667 < 5.115620124999999.
IsChangePoint: Marked as a change because one of 5/23/2022 11:22:48 PM, 5/27/2022 6:33:44 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 30.752354238261393 (T) = (0 -4759228.134838747) / Math.Sqrt((68247038336.67929 / (299)) + (4216252818.4013124 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.10978476682947236 = (5346154.455129482 - 4759228.134838747) / 5346154.455129482 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Reflection.Activator<EmptyStruct>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CreateInstanceNames - Duration of single invocation	3.42 μs	3.01 μs	0.88	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Reflection.Activator<EmptyStruct>*'

Payloads

Baseline
Compare

Histogram

System.Reflection.Activator<EmptyStruct>.CreateInstanceNames

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.007032837644862 < 3.17679483543929.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 26.861634551345446 (T) = (0 -2896.8715732069777) / Math.Sqrt((12954.618914221563 / (40)) + (1976.1069275834707 / (31))) is greater than 1.9949454151066477 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (31) - 2, .975) and 0.15437560251938146 = (3425.7190093351974 - 2896.8715732069777) / 3425.7190093351974 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Tests.Perf_DateTimeOffset

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetNow - Duration of single invocation	183.97 ns	165.47 ns	0.90	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTimeOffset*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_DateTimeOffset.GetNow

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 165.47201560991596 < 174.70065106377234.
IsChangePoint: Marked as a change because one of 7/31/2022 12:39:41 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 84.40658978232278 (T) = (0 -165.33283575225857) / Math.Sqrt((45.9623100651013 / (299)) + (0.1345769814255779 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.16872347826272494 = (198.8902987500855 - 165.33283575225857) / 198.8902987500855 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Reflection.Activator<EmptyClass>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CreateInstanceNames - Duration of single invocation	3.81 μs	3.39 μs	0.89	0.11	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Reflection.Activator<EmptyClass>*'

Payloads

Baseline
Compare

Histogram

System.Reflection.Activator<EmptyClass>.CreateInstanceNames

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.3853440574363423 < 3.592487010727553.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 32.96759240290592 (T) = (0 -3260.8573853311586) / Math.Sqrt((12910.592936327797 / (299)) + (4818.8787186011405 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.12471633194334236 = (3725.4863815419453 - 3260.8573853311586) / 3725.4863815419453 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Security.Cryptography.Tests.Perf_CryptoConfig

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CreateFromName - Duration of single invocation	574.89 ns	512.76 ns	0.89	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Security.Cryptography.Tests.Perf_CryptoConfig*'

Payloads

Baseline
Compare

Histogram

System.Security.Cryptography.Tests.Perf_CryptoConfig.CreateFromName(name: "RSA")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 512.7630004669079 < 543.2294553223923.
IsChangePoint: Marked as a change because one of 5/23/2022 1:47:22 PM, 7/27/2022 5:17:06 PM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 25.202648925090323 (T) = (0 -518.4692804576072) / Math.Sqrt((343.14188271023943 / (299)) + (30.692412993549098 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.06635580335816806 = (555.3178419814077 - 518.4692804576072) / 555.3178419814077 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Threading.Tests.Perf_Interlocked

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CompareExchange_object_NoMatch - Duration of single invocation	9.55 ns	5.11 ns	0.54	0.44	False
CompareExchange_object_Match - Duration of single invocation	10.57 ns	5.11 ns	0.48	0.45	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_Interlocked*'

Payloads

Baseline
Compare

Histogram

System.Threading.Tests.Perf_Interlocked.CompareExchange_object_NoMatch

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.111681142936111 < 7.458027787050001.
IsChangePoint: Marked as a change because one of 5/24/2022 3:42:52 PM, 6/27/2022 8:54:23 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 26.99372554222482 (T) = (0 -5.1085391982707264) / Math.Sqrt((2.6516722231786023 / (299)) + (0.18608686407066824 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.39186701153024484 = (8.400365208151825 - 5.1085391982707264) / 8.400365208151825 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Threading.Tests.Perf_Interlocked.CompareExchange_object_Match

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.110143105985888 < 9.312180008012783.
IsChangePoint: Marked as a change because one of 5/24/2022 3:42:52 PM, 6/27/2022 8:54:23 AM, 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 29.937426728377023 (T) = (0 -5.1950353198248616) / Math.Sqrt((2.967198728498809 / (299)) + (0.06490516201962912 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.3871539165665386 = (8.47690057953826 - 5.1950353198248616) / 8.47690057953826 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	0a76d1ec9906951a3486ee4ca97f1035cc7fe475
Compare	e05944dd74118db06d6987fe2724813950725737
Diff	Diff

Improvements in System.Globalization.Tests.StringSearch

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
LastIndexOf_Word_NotFound - Duration of single invocation	873.31 ns	754.45 ns	0.86	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringSearch*'

Payloads

Baseline
Compare

Histogram

System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, OrdinalIgnoreCase, False))

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 754.4466360650342 < 829.8199115154412.
IsChangePoint: Marked as a change because one of 8/17/2022 3:53:31 PM, 8/25/2022 6:55:57 AM falls between 8/16/2022 2:19:13 PM and 8/25/2022 6:55:57 AM.
IsImprovementStdDev: Marked as improvement because 418.9354920056225 (T) = (0 -754.0978159192699) / Math.Sqrt((22.017903638734754 / (299)) + (0.23112854327867266 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.13659342897205853 = (873.3982821342993 - 754.0978159192699) / 873.3982821342993 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository