pauseonstart test failures #38847
Description
tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.cmd has failed in multiple CI runs:
R2R Windows_NT x64 Checked forcerelocs @ Windows.10.Amd64.Open
set RunCrossGen=1
set COMPlus_TieredCompilation=0
set COMPlus_ForceRelocs=1
Collected crash dump C:\cores\crashdump_6592.dmp
tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.cmd [FAIL]
cmdLine:C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.cmd Timed Out
Return code: -100
Raw output file: C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\Reports\tracing.eventpipe\pauseonstart\pauseonstart\pauseonstart.output.txt
Raw output:
BEGIN EXECUTION
1 file(s) copied.
" "C:\h\w\977C081E\p\crossgen.exe" /Platform_Assemblies_Paths C:\h\w\977C081E\p;C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart /in C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.org /out C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\\pauseonstart.dll"
Microsoft (R) CoreCLR Native Image Generator - Version 5.0.0-ci
Copyright (c) Microsoft Corporation. All rights reserved.
Native image C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\\pauseonstart.dll generated successfully.
"C:\h\w\977C081E\p\corerun.exe" pauseonstart.dll
0.0s: ::== Running test: TEST_RuntimeResumesExecutionWithCommand
0.1s: Server name is 'DOTNET_TRACE_TESTS_4hx5s0ds.ucu'
0.7s: running sub-process: C:\h\w\977C081E\p\CoreRun.exe C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.dll 0
1.2s: subprocess started: True
1.2s: subprocess PID: 5256
2.8s: { Magic=System.Byte[]; ClrInstanceId=fe0342ed-a66a-d806-9784-9bed6388f8fc; ProcessId=5256; Unused=0; }
2.9s: Sent: { Header={ Magic=System.Byte[]; Size=20; CommandSet=255; CommandId=1; Reserved=0 }; }
3.1s: received: { Header={ Magic=System.Byte[]; Size=24; CommandSet=255; CommandId=0; Reserved=0 }; Payload=[ '0000' '0000' '0000' '0000' ]}
3.1s: Sending 'exit' to subprocess stdin
3.9s: ================= Subprocess Exited =================
3.9s: SubProcess exited - Exit code: 0
3.9s: Subprocess stdout:
1.0s: The runtime has been configured to pause during startup and is awaiting a Diagnostics IPC ResumeStartup command from a server at 'DOTNET_TRACE_TESTS_4hx5s0ds.ucu'.
3.1s: Subprocess started! Waiting for input...
3.1s: Received 'exit'. Exiting...
3.9s: Subprocess stderr:
4.0s: Test passed: True
4.0s:
4.0s: ::== Running test: TEST_TracesHaveRelevantEvents
4.1s: Server name is 'DOTNET_TRACE_TESTS_5oyavcdg.fvm'
4.1s: running sub-process: C:\h\w\977C081E\p\CoreRun.exe C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.dll 0
4.1s: subprocess started: True
4.1s: subprocess PID: 2216
4.1s: Standard Diagnostics Server connection not created yet -> try again in 100 ms
4.3s: Standard Diagnostics Server connection not created yet -> try again in 100 ms
4.5s: { Magic=System.Byte[]; ClrInstanceId=fd234556-3fe8-a13b-8e71-270d82f351c3; ProcessId=2216; Unused=0; }
4.6s: Starting EventPipeSession over standard connection
4.7s: Started EventPipeSession over standard connection with session id: 0x21112581990
4.8s: Send ResumeRuntime Diagnostics IPC Command
4.8s: Sent: { Header={ Magic=System.Byte[]; Size=20; CommandSet=255; CommandId=1; Reserved=0 }; }
4.8s: received: { Header={ Magic=System.Byte[]; Size=24; CommandSet=255; CommandId=0; Reserved=0 }; Payload=[ '0000' '0000' '0000' '0000' ]}
6.8s: Stopping EventPipeSession over standard connection
7.0s: Stopped EventPipeSession over standard connection
7.0s: Sending 'exit' to subprocess stdin
7.1s: ================= Subprocess Exited =================
7.1s: SubProcess exited - Exit code: 0
7.1s: Subprocess stdout:
0.3s: The runtime has been configured to pause during startup and is awaiting a Diagnostics IPC ResumeStartup command from a server at 'DOTNET_TRACE_TESTS_5oyavcdg.fvm'.
1.8s: Subprocess started! Waiting for input...
3.0s: Received 'exit'. Exiting...
7.1s: Subprocess stderr:
7.8s: isStartupEventPresent: True
7.8s: Test passed: True
7.8s:
7.8s: ::== Running test: TEST_MultipleSessionsCanBeStartedWhilepaused
7.8s: Server name is 'DOTNET_TRACE_TESTS_m2gvge2y.off'
7.8s: running sub-process: C:\h\w\977C081E\p\CoreRun.exe C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.dll 0
7.8s: subprocess started: True
7.8s: subprocess PID: 7056
7.8s: Standard Diagnostics Server connection not created yet -> try again in 100 ms
8.1s: { Magic=System.Byte[]; ClrInstanceId=8c074577-3971-cf98-8fa7-a94ed870796a; ProcessId=7056; Unused=0; }
8.1s: Starting EventPipeSession over standard connection
8.2s: Started EventPipeSession over standard connection with session id: 0x1dc8bd901c0
8.2s: Starting EventPipeSession over standard connection
8.2s: Started EventPipeSession over standard connection with session id: 0x1dc8bd8ffc0
8.2s: Starting EventPipeSession over standard connection
8.2s: Started EventPipeSession over standard connection with session id: 0x1dc8bd8fd40
8.2s: Send ResumeRuntime Diagnostics IPC Command
8.2s: Sent: { Header={ Magic=System.Byte[]; Size=20; CommandSet=255; CommandId=1; Reserved=0 }; }
8.2s: received: { Header={ Magic=System.Byte[]; Size=24; CommandSet=255; CommandId=0; Reserved=0 }; Payload=[ '0000' '0000' '0000' '0000' ]}
10.9s: Stopping EventPipeSession over standard connection
11.2s: Stopped EventPipeSession over standard connection
11.2s: Sending 'exit' to subprocess stdin
11.3s: ================= Subprocess Exited =================
11.3s: SubProcess exited - Exit code: 0
11.3s: Subprocess stdout:
0.3s: The runtime has been configured to pause during startup and is awaiting a Diagnostics IPC ResumeStartup command from a server at 'DOTNET_TRACE_TESTS_m2gvge2y.off'.
1.3s: Subprocess started! Waiting for input...
3.5s: Received 'exit'. Exiting...
11.3s: Subprocess stderr:
11.3s: nStartupEventsSeen: 3
11.3s: Test passed: True
11.3s:
11.3s: ::== Running test: TEST_CanStartAndStopSessionWhilepaused
11.3s: Server name is 'DOTNET_TRACE_TESTS_eqlrpwut.bif'
11.3s: running sub-process: C:\h\w\977C081E\p\CoreRun.exe C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.dll 0
11.4s: subprocess started: True
11.4s: subprocess PID: 2616
11.4s: Standard Diagnostics Server connection not created yet -> try again in 100 ms
11.7s: Standard Diagnostics Server connection not created yet -> try again in 100 ms
11.9s: { Magic=System.Byte[]; ClrInstanceId=67f94336-c91d-3fa7-a884-938f26d09ca4; ProcessId=2616; Unused=0; }
11.9s: Starting EventPipeSession over standard connection
11.9s: Started EventPipeSession over standard connection with session id: 0x1dbd77632b0
11.9s: Starting EventPipeSession over standard connection
11.9s: Started EventPipeSession over standard connection with session id: 0x1dbd7762e30
11.9s: Starting EventPipeSession over standard connection
11.9s: Started EventPipeSession over standard connection with session id: 0x1dbd7762f30
12.9s: Stopping EventPipeSession over standard connection
12.9s: Stopped EventPipeSession over standard connection
12.9s: Send ResumeRuntime Diagnostics IPC Command
12.9s: Sent: { Header={ Magic=System.Byte[]; Size=20; CommandSet=255; CommandId=1; Reserved=0 }; }
12.9s: received: { Header={ Magic=System.Byte[]; Size=24; CommandSet=255; CommandId=0; Reserved=0 }; Payload=[ '0000' '0000' '0000' '0000' ]}
12.9s: Sending 'exit' to subprocess stdin
13.9s: ================= Subprocess Exited =================
13.9s: SubProcess exited - Exit code: 0
13.9s: Subprocess stdout:
0.3s: The runtime has been configured to pause during startup and is awaiting a Diagnostics IPC ResumeStartup command from a server at 'DOTNET_TRACE_TESTS_eqlrpwut.bif'.
2.4s: Subprocess started! Waiting for input...
2.5s: Received 'exit'. Exiting...
13.9s: Subprocess stderr:
13.9s: Test passed: True
13.9s:
13.9s: ::== Running test: TEST_DisabledCommandsError
13.9s: Server name is 'DOTNET_TRACE_TESTS_r0gx5vln.r1j'
13.9s: running sub-process: C:\h\w\977C081E\p\CoreRun.exe C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.dll 0
13.9s: subprocess started: True
13.9s: subprocess PID: 3304
13.9s: Standard Diagnostics Server connection not created yet -> try again in 100 ms
14.3s: { Magic=System.Byte[]; ClrInstanceId=b77c4a04-4e10-da4e-9134-cb0a04cf210e; ProcessId=3304; Unused=0; }
14.3s: Send profiler attach Diagnostics IPC Command
14.3s: Sent: { Header={ Magic=System.Byte[]; Size=20; CommandSet=3; CommandId=1; Reserved=0 }; }
14.3s: received: { Header={ Magic=System.Byte[]; Size=24; CommandSet=255; CommandId=255; Reserved=0 }; Payload=[ '005B' '0013' '0013' '0080' ]}
14.6s: { Magic=System.Byte[]; ClrInstanceId=b77c4a04-4e10-da4e-9134-cb0a04cf210e; ProcessId=3304; Unused=0; }
14.6s: Send ResumeRuntime Diagnostics IPC Command
14.6s: Sent: { Header={ Magic=System.Byte[]; Size=20; CommandSet=255; CommandId=1; Reserved=0 }; }
cmdLine:C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.cmd Timed Out
Test Harness Exitcode is : -100
To run the test:
> set CORE_ROOT=C:\h\w\977C081E\p
> C:\h\w\977C081E\w\A174094B\e\tracing\eventpipe\pauseonstart\pauseonstart\pauseonstart.cmd
Expected: True
Actual: False
Also: all the Windows x86 legs of runtime-coreclr jitstress-isas-x86:
https://dev.azure.com/dnceng/public/_build/results?buildId=716582&view=ms.vss-test-web.build-test-results-tab&runId=22207570&resultId=110525&paneView=debug