You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current integration test is limited to running the SmokeTester and crash tests with a mock server that only confirms whether events were sent, without providing visibility into their content.
This creates significant testing gaps. For example, we cannot verify if scope synchronization is functioning correctly. This limitation is particularly evident when trying to observe trace changes introduced in getsentry/sentry-dotnet#4026.
There currently is no way to validate events coming from different layers of the application.
Proposal
Rather than depending on the SmokeTester to intercept .NET SDK send-attempts and validate them on the running client, we should enhance the crash-test-server to persist envelopes to disk. When executing the CrashTest, we should then validate both the presence and contents of these stored envelopes.
Implementation steps:
Start the fake server
Execute the game (SmokeTester remains to trigger errors and send events)
Server receives and persists events to disk
Verify successful game execution
Read persisted envelopes and validate their contents against expected values
Non-exhaustive list of things to check for:
Reporting SDKs name (sentry.cocoa.unity)
Synched Scope
Tags
User
Breadcrumbs
The text was updated successfully, but these errors were encountered:
As an alternative, a few other SDKs actually post events to sentry.io and then fetch them through an API. Besides resolving the pain points mentioned above, that would also enable testing symbolication.
As an alternative, a few other SDKs actually post events to sentry.io and then fetch them through an API. Besides resolving the pain points mentioned above, that would also enable testing symbolication.
React Native does this but note: It is (was?) extremely flakey and slow.
So while I'm in favor of having this (I asked for that to be added back then). I wouldn't rely on that for lots of testing.
It should be just another layer, to have perhaps a single, e2e test. But I not necessarily having lots of test cases added to it.
Problem Statement
The current integration test is limited to running the SmokeTester and crash tests with a mock server that only confirms whether events were sent, without providing visibility into their content.
This creates significant testing gaps. For example, we cannot verify if scope synchronization is functioning correctly. This limitation is particularly evident when trying to observe trace changes introduced in getsentry/sentry-dotnet#4026.
There currently is no way to validate events coming from different layers of the application.
Proposal
Rather than depending on the SmokeTester to intercept .NET SDK send-attempts and validate them on the running client, we should enhance the
crash-test-server
to persist envelopes to disk. When executing the CrashTest, we should then validate both the presence and contents of these stored envelopes.Implementation steps:
Non-exhaustive list of things to check for:
sentry.cocoa.unity
)The text was updated successfully, but these errors were encountered: