Skip to content

Make tests and infrastructure less flaky #273

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

NikolaSimsic
Copy link
Contributor

Scope of this PR:

  • Improve "Start runtime" phase with adding a retry mechanism since its failure leads to breaking a test
  • Add a timeout for each matrix test execution, it can happen that sometimes it gets stuck, leading to blocking the whole pipeline
  • Increasing SP version
  • Improve several test cases where image is loaded with a wait time in order to wait for image to load, it can take few seconds due to emulator/simulator limited resources
  • Update some screenshots and improve screenshot comparison logic with ignoring specific right part of the screen for android devices, scroll bar sometimes is displayed during execution and sometimes not, which leads to flakiness

@NikolaSimsic NikolaSimsic requested a review from a team as a code owner June 16, 2025 14:02
@NikolaSimsic NikolaSimsic force-pushed the moo/update-tests branch 3 times, most recently from e6d2b05 to a5e5547 Compare June 19, 2025 09:08
@NikolaSimsic NikolaSimsic force-pushed the moo/update-tests branch 2 times, most recently from 1778cd0 to 8da1cbf Compare June 19, 2025 10:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants