-
Notifications
You must be signed in to change notification settings - Fork 4
Description
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_VectorOf<SByte>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
DotBenchmark - Duration of single invocation | 108.99 ns | 116.53 ns | 1.07 | 0.02 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorOf<SByte>.DotBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 116.53128700894062 > 114.13300568785758.
IsChangePoint: Marked as a change because one of 10/19/2022 7:27:15 PM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -24.055120730119537 (T) = (0 -116.20240795819248) / Math.Sqrt((0.05082110012029848 / (16)) + (3.607032383475639 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.06933231066459594 = (108.66819116872288 - 116.20240795819248) / 108.66819116872288 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
Diff | Diff |
Regressions in System.Net.Tests.Perf_WebUtility
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Decode_NoDecodingRequired - Duration of single invocation | 90.30 ns | 100.48 ns | 1.11 | 0.03 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Tests.Perf_WebUtility*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Net.Tests.Perf_WebUtility.Decode_NoDecodingRequired
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 100.478930233393 > 95.33756007589776.
IsChangePoint: Marked as a change because one of 9/29/2022 7:42:19 AM, 10/5/2022 3:28:28 PM, 10/11/2022 5:13:36 PM, 10/19/2022 7:27:15 PM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -23.224983581206367 (T) = (0 -102.73650673155882) / Math.Sqrt((0.1814190388664714 / (16)) + (9.616211625790637 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.1315300155438853 = (90.79432743299975 - 102.73650673155882) / 90.79432743299975 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
Diff | Diff |
Regressions in System.Collections.IterateForNonGeneric<String>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
ArrayList - Duration of single invocation | 1.62 μs | 1.77 μs | 1.09 | 0.07 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForNonGeneric<String>*'
Related Issues
Regressions
- [Perf] Windows/x64: 29 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Alpine/x64: 22 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Linux/x64: 22 Regressions on 11/7/2022 8:57:30 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.Collections.IterateForNonGeneric<String>.ArrayList(Size: 512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 1.766990992522094 > 1.6655960963812322.
IsChangePoint: Marked as a change because one of 9/13/2022 12:23:36 PM, 9/29/2022 7:42:19 AM, 10/10/2022 3:36:43 PM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -17.01426204245732 (T) = (0 -1752.6902198077767) / Math.Sqrt((114.17652402606289 / (16)) + (3194.5288781209397 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.10217951999834864 = (1590.2039441001432 - 1752.6902198077767) / 1590.2039441001432 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
Diff | Diff |
Regressions in System.Memory.Span<Int32>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
IndexOfAnyFiveValues - Duration of single invocation | 607.15 ns | 788.36 ns | 1.30 | 0.02 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span<Int32>*'
Related Issues
Regressions
- [Perf] Windows/x64: 29 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Alpine/x64: 22 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Linux/x64: 22 Regressions on 11/7/2022 8:57:30 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.Memory.Span<Int32>.IndexOfAnyFiveValues(Size: 512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 788.3622771094617 > 635.7849553242798.
IsChangePoint: Marked as a change because one of 9/26/2022 8:26:31 AM, 9/27/2022 11:22:50 AM, 10/18/2022 1:35:00 AM, 10/19/2022 7:27:15 PM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -24.374959330172658 (T) = (0 -784.6372859604586) / Math.Sqrt((2.6951136599407315 / (16)) + (2049.3468937054945 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.2961602552549634 = (605.3551501670719 - 784.6372859604586) / 605.3551501670719 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
Diff | Diff |
Regressions in System.Collections.ContainsTrueComparer<Int32>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
ImmutableHashSet - Duration of single invocation | 23.97 μs | 25.92 μs | 1.08 | 0.02 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsTrueComparer<Int32>*'
Related Issues
Regressions
- [Perf] Windows/x64: 29 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Alpine/x64: 22 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Linux/x64: 22 Regressions on 11/7/2022 8:57:30 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.Collections.ContainsTrueComparer<Int32>.ImmutableHashSet(Size: 512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 25.9170582497213 > 24.96908331545985.
IsChangePoint: Marked as a change because one of 9/13/2022 12:23:36 PM, 10/11/2022 5:13:36 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -38.081394360054 (T) = (0 -25970.694618121826) / Math.Sqrt((26393.897669153394 / (16)) + (53066.28023256958 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.08805459368540271 = (23868.926034451288 - 25970.694618121826) / 23868.926034451288 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
Diff | Diff |
Regressions in PerfLabTests.CastingPerf2.CastingPerf
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
IFooObjIsIFooInterAlia - Duration of single invocation | 353.60 μs | 405.10 μs | 1.15 | 0.04 | False | |||||
FooObjIsFoo - Duration of single invocation | 438.87 μs | 561.30 μs | 1.28 | 0.06 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'
Related Issues
Regressions
- [Perf] Windows/x64: 29 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Alpine/x64: 22 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Linux/x64: 22 Regressions on 11/7/2022 8:57:30 PM
Improvements
Payloads
Histogram
Edge Detector Info
PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 405.09930555555565 > 375.44781889204546.
IsChangePoint: Marked as a change because one of 9/29/2022 7:42:19 AM, 10/2/2022 4:08:26 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -34.161041512883614 (T) = (0 -405491.0484712702) / Math.Sqrt((14171887.67362223 / (16)) + (40916434.8629844 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.1338118900954479 = (357635.2056399185 - 405491.0484712702) / 357635.2056399185 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.CastingPerf2.CastingPerf.FooObjIsFoo
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 561.3027214972527 > 461.5588541666668.
IsChangePoint: Marked as a change because one of 9/9/2022 3:12:19 AM, 9/13/2022 12:23:36 PM, 9/29/2022 7:42:19 AM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -23.58441945755964 (T) = (0 -555379.024709735) / Math.Sqrt((50218682.30058106 / (16)) + (749805482.5983034 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.2548350431078822 = (442591.26150494925 - 555379.024709735) / 442591.26150494925 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
Diff | Diff |
Regressions in PerfLabTests.DelegatePerf
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
DelegateInvoke - Duration of single invocation | 436.57 μs | 500.97 μs | 1.15 | 0.01 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.DelegatePerf*'
Related Issues
Regressions
- [Perf] Windows/x64: 29 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Alpine/x64: 22 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Linux/x64: 22 Regressions on 11/7/2022 8:57:30 PM
Improvements
Payloads
Histogram
Edge Detector Info
PerfLabTests.DelegatePerf.DelegateInvoke
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 500.9673828125 > 458.39899826388887.
IsChangePoint: Marked as a change because one of 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -25.34588843310316 (T) = (0 -496185.0848723244) / Math.Sqrt((1349993.977098318 / (16)) + (203611894.0705481 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.13529262918671175 = (437054.7928491141 - 496185.0848723244) / 437054.7928491141 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
Diff | Diff |
Regressions in System.Collections.IterateForEach<Int32>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Stack - Duration of single invocation | 1.62 μs | 1.79 μs | 1.11 | 0.03 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<Int32>*'
Related Issues
Regressions
- [Perf] Windows/x64: 29 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Alpine/x64: 22 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Linux/x64: 22 Regressions on 11/7/2022 8:57:30 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.Collections.IterateForEach<Int32>.Stack(Size: 512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 1.7865885982984249 > 1.697107892054271.
IsChangePoint: Marked as a change because one of 10/2/2022 4:08:26 PM, 10/26/2022 7:11:30 AM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -21.89738800766249 (T) = (0 -1771.1773444507362) / Math.Sqrt((172.42129739815752 / (16)) + (1382.1820393748276 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.09276771589943592 = (1620.8177810166312 - 1771.1773444507362) / 1620.8177810166312 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
Diff | Diff |
Regressions in PerfLabTests.LowLevelPerf
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
GenericClassWithIntGenericInstanceField - Duration of single invocation | 31.20 μs | 62.37 μs | 2.00 | 0.05 | False | |||||
GenericGenericMethod - Duration of single invocation | 156.57 μs | 187.87 μs | 1.20 | 0.02 | False | |||||
TypeReflectionObjectGetType - Duration of single invocation | 135.03 μs | 155.93 μs | 1.15 | 0.06 | False | |||||
SealedClassInterfaceMethod - Duration of single invocation | 157.17 μs | 187.10 μs | 1.19 | 0.05 | False | |||||
ClassVirtualMethod - Duration of single invocation | 155.93 μs | 187.98 μs | 1.21 | 0.04 | False | |||||
NewDelegateClassEmptyInstanceFn - Duration of single invocation | 473.95 μs | 542.67 μs | 1.14 | 0.06 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.LowLevelPerf*'
Related Issues
Regressions
- [Perf] Windows/x64: 29 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Alpine/x64: 22 Regressions on 11/7/2022 8:57:30 PM
- [Perf] Linux/x64: 22 Regressions on 11/7/2022 8:57:30 PM
Improvements
Payloads
Histogram
Edge Detector Info
PerfLabTests.LowLevelPerf.GenericClassWithIntGenericInstanceField
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 62.372497509960155 > 32.755558196107785.
IsChangePoint: Marked as a change because one of 9/9/2022 3:12:19 AM, 9/13/2022 12:23:36 PM, 10/10/2022 3:36:43 PM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -25.07492453077389 (T) = (0 -60721.54230846032) / Math.Sqrt((2884.604974162607 / (16)) + (51209363.653565265 / (37))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (37) - 2, .025) and -0.9449439238398355 = (31220.202065558722 - 60721.54230846032) / 31220.202065558722 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.LowLevelPerf.GenericGenericMethod
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 187.87178356282274 > 164.05836768254952.
IsChangePoint: Marked as a change because one of 10/2/2022 11:57:04 PM, 10/5/2022 3:28:28 PM, 10/19/2022 7:27:15 PM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -25.544601566823594 (T) = (0 -185654.75887970216) / Math.Sqrt((96073.91234872164 / (16)) + (50548967.82046936 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.18913222390387555 = (156126.2533700455 - 185654.75887970216) / 156126.2533700455 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.LowLevelPerf.TypeReflectionObjectGetType
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 155.92978547854784 > 140.9372725052789.
IsChangePoint: Marked as a change because one of 10/13/2022 10:51:15 PM, 10/18/2022 1:35:00 AM, 10/27/2022 9:29:16 PM, 11/7/2022 4:10:19 PM, 11/13/2022 1:28:42 PM, 11/14/2022 3:36:58 AM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -3.3654198619940647 (T) = (0 -156138.2782178218) / Math.Sqrt((634998022.1266983 / (51)) + (140914.48335860358 / (3))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (51) + (3) - 2, .025) and -0.08248408022571722 = (144240.71547108958 - 156138.2782178218) / 144240.71547108958 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.LowLevelPerf.SealedClassInterfaceMethod
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 187.10187074829932 > 164.9829234375.
IsChangePoint: Marked as a change because one of 9/1/2022 8:04:48 PM, 9/13/2022 12:23:36 PM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -26.63046457683598 (T) = (0 -186027.09638223617) / Math.Sqrt((23122.92242811073 / (16)) + (44783010.63597491 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.184134183942409 = (157099.67578411172 - 186027.09638223617) / 157099.67578411172 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.LowLevelPerf.ClassVirtualMethod
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 187.97501594387754 > 163.72991098629095.
IsChangePoint: Marked as a change because one of 9/1/2022 8:04:48 PM, 9/13/2022 12:23:36 PM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -25.68130590695422 (T) = (0 -185572.18993040043) / Math.Sqrt((50541.029378381434 / (16)) + (50220204.19160024 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.18946122403606058 = (156013.65238348828 - 185572.18993040043) / 156013.65238348828 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### PerfLabTests.LowLevelPerf.NewDelegateClassEmptyInstanceFn
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 542.6676867816092 > 503.77536268939394.
IsChangePoint: Marked as a change because one of 9/4/2022 8:45:57 AM, 9/5/2022 12:53:33 AM, 10/10/2022 3:36:43 PM, 10/25/2022 12:27:43 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -20.9408873733118 (T) = (0 -534153.7647523409) / Math.Sqrt((17563546.880457427 / (16)) + (207644895.55960655 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.11163807340564307 = (480510.49845377606 - 534153.7647523409) / 480510.49845377606 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository