-
Notifications
You must be signed in to change notification settings - Fork 10.3k
Template tests are run twice azdo + helix #30756
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
Going to address this to see if the blazor template flakiness is from azdo or helix runs |
Note, looks like the flakiness is almost entirely on the azdo side. There hasn't been any failures on the helix blazor template work items since 4/27. I'm going to remove the templates test job from ci as all project template tests are helix ready so the job is no longer needed |
We see lots of failures in the Helix jobs with Were you looking only at the Helix jobs for 'main'❔ |
I was just looking at the quarantined-pr analytics which showed no blazortemplate.tests--net6.0 failures in the past 14 days, as compared to the pretty awful 56-97% pass rate of the azdo runs in the same time frame. I was just hoping to get rid of the extra noise since the helix blazor templates looks like something like 9/1k runs passed in the last 30 days, for like 98%+ which actually looks reasonable for them to be unquarantined since all the failures were between 4-26 and 4-27 and likely due a sdk issue |
But the basic idea is we aren't going to be running these tests on azdo in the long term anyways, we might as well stop wasting the CPU cycles, and its adding a lot of noise to the quarantined results since we only care about the helix runs |
Alrighty-o I can buy that. Is #32985 ready for review❔ |
See #30703 (comment) for more context, but basically today we run the template tests on both the helix job and the windows test job, this issue is to track following up and deciding what the long term plan is here. cc @dougbu
The text was updated successfully, but these errors were encountered: