[Perf] Windows/x64: 3 Regressions on 9/27/2022 4:04:11 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Regressions in System.Tests.Perf_GC<Char>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
AllocateArray - Duration of single invocation	173.27 ns	182.97 ns	1.06	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_GC<Char>*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_GC<Char>.AllocateArray(length: 1000, pinned: True)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 182.97462814578097 > 181.32044957301588.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 8/17/2022 6:09:21 PM, 8/31/2022 10:21:55 AM, 9/20/2022 8:04:40 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -5.851146516548747 (T) = (0 -187.69743969869592) / Math.Sqrt((110.73768106162251 / (26)) + (31.502948089878164 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.07514981487884137 = (174.57793983794485 - 187.69743969869592) / 174.57793983794485 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Regressions in System.Reflection.Invoke

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Ctor0_ActivatorCreateInstance_NoParams - Duration of single invocation	7.25 ns	8.82 ns	1.22	0.32	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Reflection.Invoke*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Reflection.Invoke.Ctor0_ActivatorCreateInstance_NoParams

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.817766919458967 > 7.600075895237593.
IsChangePoint: Marked as a change because one of 9/8/2022 11:29:08 PM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -12.32030223506991 (T) = (0 -9.350576172711174) / Math.Sqrt((0.36987895198869647 / (26)) + (0.3178857634393414 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.24276089527750044 = (7.524034758611592 - 9.350576172711174) / 7.524034758611592 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Regressions in System.Collections.Tests.Perf_BitArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
BitArrayAnd - Duration of single invocation	12.20 ns	13.83 ns	1.13	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_BitArray*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.830627558228644 > 12.835680390501295.
IsChangePoint: Marked as a change because one of 8/5/2022 12:58:40 PM, 8/16/2022 10:54:40 PM, 9/13/2022 12:23:36 PM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -13.396929840437531 (T) = (0 -13.657296459554154) / Math.Sqrt((0.2558546425918334 / (26)) + (0.012157726400674486 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.10958688390310778 = (12.308451602737895 - 13.657296459554154) / 12.308451602737895 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Improvements in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryWriteBytes - Duration of single invocation	12.94 ns	2.87 ns	0.22	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address: 1020:3040:5060:7080:9010:1112:1314:1516)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.8748243270043785 < 12.293023246159201.
IsChangePoint: Marked as a change because one of 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsImprovementStdDev: Marked as improvement because 121.83970798136679 (T) = (0 -2.8858323085073985) / Math.Sqrt((2.775632053956028 / (299)) + (0.0002864049779248087 / (41))) is greater than 1.9670073106672175 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (41) - 2, .975) and 0.8027365644099652 = (14.629332090235495 - 2.8858323085073985) / 14.629332090235495 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Regressions in System.ComponentModel.Tests.Perf_TypeDescriptorTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetConverter - Duration of single invocation	134.41 ns	155.43 ns	1.16	0.02	False
GetConverter - Duration of single invocation	137.18 ns	158.49 ns	1.16	0.03	False
GetConverter - Duration of single invocation	135.38 ns	158.83 ns	1.17	0.03	False
GetConverter - Duration of single invocation	136.95 ns	155.39 ns	1.13	0.02	False
GetConverter - Duration of single invocation	136.41 ns	156.45 ns	1.15	0.02	False
GetConverter - Duration of single invocation	90.71 ns	95.51 ns	1.05	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.ComponentModel.Tests.Perf_TypeDescriptorTests*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(int?))

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 155.43332785231956 > 141.25415251794377.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -40.10068207458744 (T) = (0 -157.65674504760273) / Math.Sqrt((1.1833222935769914 / (26)) + (10.54376641680511 / (40))) is less than -1.997729654317006 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (40) - 2, .025) and -0.16470609039270134 = (135.36182763021867 - 157.65674504760273) / 135.36182763021867 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.DerivedClass))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 158.49480394192668 > 142.29517455374844.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -52.53676451078664 (T) = (0 -158.1892389005805) / Math.Sqrt((0.4575924917621642 / (26)) + (6.148941686525072 / (36))) is less than -2.0002978220134566 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (36) - 2, .025) and -0.16843647548317262 = (135.385399394662 - 158.1892389005805) / 135.385399394662 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.SomeValueType?))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 158.82695642596292 > 142.3364657608359.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -29.38773986953571 (T) = (0 -159.3043911426062) / Math.Sqrt((0.2331094401681945 / (26)) + (22.419684386731294 / (35))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (35) - 2, .025) and -0.17463928901270803 = (135.6198389009298 - 159.3043911426062) / 135.6198389009298 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.Guid))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 155.38940152774117 > 142.80309027470938.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -48.42968952129371 (T) = (0 -158.46829013220133) / Math.Sqrt((0.6704949539414301 / (26)) + (7.219881439448422 / (38))) is less than -1.998971517032675 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (38) - 2, .025) and -0.1654530911082438 = (135.97140145856224 - 158.46829013220133) / 135.97140145856224 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(int))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 156.45038848451205 > 143.21904340191236.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -37.80570029908468 (T) = (0 -157.38461131431012) / Math.Sqrt((1.6104855883785525 / (26)) + (9.377915685086414 / (39))) is less than -1.9983405425199077 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (39) - 2, .025) and -0.15219997763168272 = (136.59487447466378 - 157.38461131431012) / 136.59487447466378 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(string))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 95.50787595617935 > 95.35180304127276.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:16:12 AM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -18.109803161227873 (T) = (0 -96.38505571926237) / Math.Sqrt((0.21590191918048227 / (26)) + (3.1605518302101636 / (39))) is less than -1.9983405425199077 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (39) - 2, .025) and -0.05950290535589061 = (90.97195980494863 - 96.38505571926237) / 90.97195980494863 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Regressions in Microsoft.Extensions.DependencyInjection.GetService

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Transient - Duration of single invocation	23.15 ns	25.21 ns	1.09	0.15	False
Singleton - Duration of single invocation	17.93 ns	19.26 ns	1.07	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.DependencyInjection.GetService*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

Microsoft.Extensions.DependencyInjection.GetService.Transient

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.209263640485577 > 23.810016965081378.
IsChangePoint: Marked as a change because one of 8/9/2022 6:41:10 AM, 9/22/2022 3:16:12 AM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -10.430729235773748 (T) = (0 -25.036067122669866) / Math.Sqrt((0.5107815387245573 / (26)) + (0.5456046414556772 / (38))) is less than -1.998971517032675 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (38) - 2, .025) and -0.08321980964805634 = (23.11263780414449 - 25.036067122669866) / 23.11263780414449 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Microsoft.Extensions.DependencyInjection.GetService.Singleton

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.260141334335017 > 18.950715274159318.
IsChangePoint: Marked as a change because one of 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -11.888953793105449 (T) = (0 -19.33164374320402) / Math.Sqrt((0.33488213736136063 / (26)) + (0.1462465495480798 / (39))) is less than -1.9983405425199077 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (39) - 2, .025) and -0.08614039628131652 = (17.798475969949113 - 19.33164374320402) / 17.798475969949113 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Regressions in System.ComponentModel.Tests.Perf_TypeDescriptorTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetConverter - Duration of single invocation	129.58 ns	152.31 ns	1.18	0.02	False
GetConverter - Duration of single invocation	130.18 ns	152.23 ns	1.17	0.02	False
GetConverter - Duration of single invocation	129.71 ns	154.37 ns	1.19	0.02	False
GetConverter - Duration of single invocation	129.57 ns	150.59 ns	1.16	0.04	False
GetConverter - Duration of single invocation	131.61 ns	152.17 ns	1.16	0.03	False
GetConverter - Duration of single invocation	129.84 ns	151.11 ns	1.16	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.ComponentModel.Tests.Perf_TypeDescriptorTests*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.SomeValueType?))

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 152.31316565487788 > 137.17657819693682.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -99.88362668509131 (T) = (0 -153.11217326178854) / Math.Sqrt((0.18385484649088435 / (26)) + (1.7790250299388823 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.1717063853299083 = (130.67452322424438 - 153.11217326178854) / 130.67452322424438 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(int))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 152.23037884729294 > 136.7380153697019.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -40.937057944298125 (T) = (0 -151.25507214272272) / Math.Sqrt((1.72778481990224 / (26)) + (7.037342171537875 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.15215790098479884 = (131.27981157221464 - 151.25507214272272) / 131.27981157221464 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.DerivedClass))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 154.3689497750926 > 137.40219446963806.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -53.9478003118524 (T) = (0 -152.5115556357653) / Math.Sqrt((0.9926081347240137 / (26)) + (5.079738371191062 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.16605223490310408 = (130.7930734753393 - 152.5115556357653) / 130.7930734753393 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(int?))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 150.59102546478138 > 136.47261917214556.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -31.70928839058028 (T) = (0 -151.90723774487728) / Math.Sqrt((1.606970345967593 / (26)) + (17.322312270654983 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.16995562279398596 = (129.84017067425657 - 151.90723774487728) / 129.84017067425657 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.Guid))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 152.16840202089577 > 138.878578010726.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -30.063168366304797 (T) = (0 -151.5702208962782) / Math.Sqrt((7.194035799284773 / (26)) + (4.960381372371083 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.14296130413999072 = (132.61185689075066 - 151.5702208962782) / 132.61185689075066 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.Enum))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 151.1054261781558 > 136.1426455281977.
IsChangePoint: Marked as a change because one of 7/22/2022 1:09:02 AM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -69.36611584281223 (T) = (0 -151.3816465172097) / Math.Sqrt((1.5929665215327473 / (26)) + (1.1154194539253646 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.15780286121051926 = (130.74906928363905 - 151.3816465172097) / 130.74906928363905 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	alpine 3.15
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Regressions in System.Tests.Perf_UInt32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Parse - Duration of single invocation	15.32 ns	17.18 ns	1.12	0.26	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt32*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_UInt32.Parse(value: "4294967295")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.176781372991492 > 15.477083649221054.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/6/2022 8:41:56 AM, 7/13/2022 7:22:00 AM, 8/5/2022 10:47:59 PM, 9/13/2022 12:23:36 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -5.8953483307709575 (T) = (0 -17.590630853498624) / Math.Sqrt((3.7401314178524028 / (26)) + (0.8859004342952506 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.15784173435779902 = (15.192603903896527 - 17.590630853498624) / 15.192603903896527 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Regressions in PerfLabTests.EnumPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ObjectGetType - Duration of single invocation	0.21 ns	1.52 ns	7.25	0.50	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.EnumPerf*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

PerfLabTests.EnumPerf.ObjectGetType

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.521990637893239 > 0.22056177809842872.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -54.93229951159392 (T) = (0 -1.5277721439570648) / Math.Sqrt((2.5677337847564474E-05 / (26)) + (0.023610464549499107 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -6.330200434273073 = (0.2084216056103754 - 1.5277721439570648) / 0.2084216056103754 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Regressions in System.Tests.Perf_Array

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Reverse - Duration of single invocation	13.40 ns	17.84 ns	1.33	0.12	False
Clear - Duration of single invocation	68.66 ns	74.04 ns	1.08	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Array*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Array.Reverse

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.837090355813533 > 14.070848765112867.
IsChangePoint: Marked as a change because one of 9/13/2022 10:08:53 PM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -14.026850684453892 (T) = (0 -17.294995933451357) / Math.Sqrt((0.7708563207266657 / (26)) + (1.6767108048137451 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.2745534431358257 = (13.569455268113286 - 17.294995933451357) / 13.569455268113286 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Array.Clear

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 74.03819046444293 > 72.09444890180562.
IsChangePoint: Marked as a change because one of 9/13/2022 12:23:36 PM, 9/22/2022 3:11:11 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsRegressionStdDev: Marked as regression because -15.252301554756322 (T) = (0 -73.97145353767871) / Math.Sqrt((1.6385490681361659 / (26)) + (0.3957363530918819 / (41))) is less than -1.997137908391408 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (41) - 2, .025) and -0.05885666059183394 = (69.8597423907532 - 73.97145353767871) / 69.8597423907532 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Improvements in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryWriteBytes - Duration of single invocation	13.48 ns	2.02 ns	0.15	0.02	False
GetAddressBytes - Duration of single invocation	19.68 ns	7.27 ns	0.37	0.04	False
Ctor_Span - Duration of single invocation	18.77 ns	14.10 ns	0.75	0.07	False
Ctor_Bytes - Duration of single invocation	18.88 ns	13.67 ns	0.72	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address: 1020:3040:5060:7080:9010:1112:1314:1516)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.0244380897407313 < 12.81653395858981.
IsChangePoint: Marked as a change because one of 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsImprovementStdDev: Marked as improvement because 460.0544004860377 (T) = (0 -1.836395846316969) / Math.Sqrt((0.01979443827520601 / (299)) + (0.02053633320767855 / (36))) is greater than 1.9671134448822736 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (36) - 2, .975) and 0.8634092070449666 = (13.444506811828244 - 1.836395846316969) / 13.444506811828244 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.GetAddressBytes(address: 1020:3040:5060:7080:9010:1112:1314:1516)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.2674857555743 < 18.962094425520565.
IsChangePoint: Marked as a change because one of 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsImprovementStdDev: Marked as improvement because 183.05914390448615 (T) = (0 -7.135439303904675) / Math.Sqrt((1.156954974441656 / (299)) + (0.03166361929279722 / (39))) is greater than 1.9670493839589689 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (39) - 2, .975) and 0.6370645530526031 = (19.660353828538746 - 7.135439303904675) / 19.660353828538746 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address: [16, 32, 48, 64, 80, ...])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 14.101122917360135 < 17.92863123515939.
IsChangePoint: Marked as a change because one of 8/9/2022 6:41:10 AM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsImprovementStdDev: Marked as improvement because 66.43943528504103 (T) = (0 -13.567936233986009) / Math.Sqrt((0.8828567370082664 / (299)) + (0.1276521018995479 / (38))) is greater than 1.967070609662329 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (38) - 2, .975) and 0.28007839115193117 = (18.84640781333925 - 13.567936233986009) / 18.84640781333925 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Bytes(address: [16, 32, 48, 64, 80, ...])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.67275989420442 < 18.61857606462994.
IsChangePoint: Marked as a change because one of 8/9/2022 6:41:10 AM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsImprovementStdDev: Marked as improvement because 69.37749417635014 (T) = (0 -13.505199689175944) / Math.Sqrt((0.9944291788118576 / (299)) + (0.11158948564882881 / (39))) is greater than 1.9670493839589689 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (39) - 2, .975) and 0.2877872630102412 = (18.962311382210146 - 13.505199689175944) / 18.962311382210146 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	007563949e53bad52dfcdf95927b0ce00101df4d
Compare	1f688ed75133664aa20c838fa451e2ecf9f1f424
Diff	Diff

Improvements in System.Collections.Tests.Perf_SortedSet

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Max - Duration of single invocation	30.83 ns	14.92 ns	0.48	0.35	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_SortedSet*'

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.Tests.Perf_SortedSet.Max

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 14.922893633360665 < 28.832030337762358.
IsChangePoint: Marked as a change because one of 9/13/2022 12:23:36 PM, 9/22/2022 4:52:57 PM, 9/27/2022 11:22:50 AM, 10/4/2022 5:30:44 AM falls between 9/25/2022 5:06:47 PM and 10/4/2022 5:30:44 AM.
IsImprovementStdDev: Marked as improvement because 2.557199518495326 (T) = (0 -16.682679470490545) / Math.Sqrt((26.34125914349734 / (299)) + (12.595197316230838 / (39))) is greater than 1.9670493839589689 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (39) - 2, .975) and 0.08948197208410962 = (18.32218468938609 - 16.682679470490545) / 18.32218468938609 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository