[Perf] Windows/arm64: 5 Improvements on 11/7/2022 8:57:30 PM #9689
Description
Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.25094 |
| Baseline | bfa4812aec806f09f1e2927939ba98118e5e5bf7 |
| Compare | 2aebbf75167b3aa21cae23e6fd702688dd724663 |
| Diff | Diff |
Improvements in System.IO.Tests.StreamReaderReadLineTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ReadLine - Duration of single invocation | 39.57 μs | 13.80 μs | 0.35 | 0.55 | False | |||||
| ReadLine - Duration of single invocation | 43.53 μs | 14.16 μs | 0.33 | 0.58 | False | |||||
| ReadLine - Duration of single invocation | 50.65 μs | 15.14 μs | 0.30 | 0.58 | False | |||||
| ReadLine - Duration of single invocation | 57.56 μs | 46.38 μs | 0.81 | 0.57 | False | |||||
| ReadLine - Duration of single invocation | 49.31 μs | 21.83 μs | 0.44 | 0.55 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StreamReaderReadLineTests*'Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 129, 1024])
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.80136596958175 < 41.958699701318444.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 65.95500048825585 (T) = (0 -13834.610003406791) / Math.Sqrt((8546873.889663717 / (299)) + (1203323.5098501043 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.6809843978493509 = (43366.56235663879 - 13834.610003406791) / 43366.56235663879 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 1024])
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 14.157511976744185 < 41.77659850767296.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 83.58889460409634 (T) = (0 -13291.898867222513) / Math.Sqrt((7519252.257957592 / (299)) + (721061.9008611278 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.6924302709095511 = (43215.887683516754 - 13291.898867222513) / 43215.887683516754 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048])
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.137922845691385 < 45.07923367165876.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 83.57681160842189 (T) = (0 -14085.612729065137) / Math.Sqrt((12480087.280047791 / (299)) + (734493.7902230732 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.6944097995873105 = (46093.142744901445 - 14085.612729065137) / 46093.142744901445 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 9, 32])
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 46.38491604477611 < 62.28481693279347.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 17.045812102824712 (T) = (0 -44970.7112777283) / Math.Sqrt((20832602.589264795 / (299)) + (9462891.905442135 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.31125792825745385 = (65293.98031973061 - 44970.7112777283) / 65293.98031973061 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 33, 128])
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.827997863247862 < 43.80401422747017.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/10/2022 12:18:51 PM falls between 11/1/2022 10:53:48 PM and 11/10/2022 12:18:51 PM.
IsImprovementStdDev: Marked as improvement because 51.19968453771315 (T) = (0 -20558.37452666308) / Math.Sqrt((9328380.24684689 / (299)) + (1369940.596201246 / (7))) is greater than 1.9677981407170237 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (7) - 2, .975) and 0.5426093359835911 = (44947.07947498803 - 20558.37452666308) / 44947.07947498803 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository