Massive long running tests on Linux #56477
Description
Failures 7/8-9/6 (incl. PRs):
| Day | Run | OS | Notes | Runtime |
|---|---|---|---|---|
| 7/16 | PR #55776 - Preview 7 branch | Fedora.32.Amd64.Open | 32 tests | CoreCLR |
| 7/16 | PR #55710 | Centos.8.Amd64.Open | 37 tests | CoreCLR |
| 7/16 | PR #55666 | Centos.8.Amd64.Open | 39 tests | CoreCLR |
| 7/21 | PR #56035 - Preview 7 branch | Ubuntu.1604.Amd64.Open | 43 tests | CoreCLR |
| 7/21 | PR #55664 | Alpine.312.Amd64.Open | 38 tests | CoreCLR |
| 7/22 | PR #55683 | Fedora.32.Amd64.Open | 42 tests | CoreCLR |
| 7/25 | PR #56277 | Fedora.32.Amd64.Open | 45 tests | CoreCLR |
| 7/27 | PR #54991 | Centos.8.Amd64.Open | 43 tests | CoreCLR |
| 7/27 | PR #56413 | Debian.10.Amd64.Open | 41 tests | CoreCLR |
| 7/28 | PR #55102 | Ubuntu.1604.Amd64.Open | 36 tests | CoreCLR |
| 7/28 | PR #56488 | Fedora.32.Amd64.Open | 40 tests | CoreCLR |
| 7/29 | PR #56600 | Debian.10.Amd64.Open | 37 tests | CoreCLR |
| 7/30 | Official run | Alpine.312.Amd64.Open | 41 tests | CoreCLR |
| 7/31 | PR #56568 | Centos.8.Amd64.Open | 36 tests | CoreCLR |
| 7/31 | Official run | Fedora.34.Amd64.Open | 32 tests | CoreCLR |
| 8/3 | PR #56768 | Ubuntu.1804.Amd64.Open | 36 tests | CoreCLR |
| 8/4 | PR #55916 | SLES.15.Amd64.Open | 37 tests | CoreCLR |
| 8/4 | PR #54640 | Centos.8.Amd64.Open | 40 tests | CoreCLR |
| 8/4 | PR #56862 | Centos.8.Amd64.Open | 38 tests | CoreCLR |
| 8/5 | PR #56909 | Fedora.34.Amd64.Open | -- | CoreCLR |
| 8/11 | PR #57178 | Alpine.312.Amd64.Open | -- | CoreCLR |
| 8/11 | Attempted fix in PR #56966 (also in release/6.0 and 6.0-rc1 branches) |
|||
| 8/12 | Official run | Debian.10.Amd64.Open | -- | CoreCLR |
| 8/17 | PR #57530 (created on 8/17) | Debian.10.Amd64.Open | 38 tests | CoreCLR |
| 8/19 | PR #57741 - release/6.0 | SLES.15.Amd64.Open | 39 tests | CoreCLR |
| 8/29 | Official run (main = 7.0) | Debian.10.Amd64.Open | 36 tests | CoreCLR |
| 9/3 | Official run - release/6.0 | Ubuntu.1604.Amd64.Open | 39 tests | CoreCLR |
Addressed on 8/11 in PR #56966
Perhaps a regression introduced around 7/16? Higher frequency: ~1/day
Prior to 7/8 we do not have console outputs, but the frequency seems to be significantly lower - <1/week across all OS versions
Data from 3/29-7/8:
| Day | Run | OS | Runtime |
|---|---|---|---|
| 3/29 | Official run | SLES.12.Amd64.Open | CoreCLR |
| 4/9 | Official run | OSX.1015.Amd64.Open | CoreCLR |
| 4/14 | Official run | Windows.10.Amd64.ServerRS5.Open | CoreCLR |
| 4/26 | PR #51873 | Windows.10.Amd64.Server19H1.Open | CoreCLR |
| 5/14 | Official run | Alpine.312.Amd64.Open | CoreCLR |
| 5/18 | PR #52887 | Windows.10.Amd64.Server19H1.Open | CoreCLR |
| 5/31 | PR #53471 | Debian.10.Amd64.Open | CoreCLR |
| 6/8 | PR #53851 | Centos.8.Amd64.Open | CoreCLR |
| 6/24 | PR #54618 | Windows.10.Amd64.Android.Open | Mono |