Skip to content

Conversation

boomanaiden154
Copy link
Contributor

This is intended to catch failures like
https://lab.llvm.org/staging/#/builders/192/builds/1671 (LLDB formatter related) before they end up landing in tree.

@boomanaiden154 boomanaiden154 marked this pull request as ready for review August 25, 2025 17:46
@boomanaiden154
Copy link
Contributor Author

@ldionne @philnik777 @EricWF Any thoughts on this?

@philnik777
Copy link
Contributor

I thought the lldb tests should already be run in the bootstrapping build?

@boomanaiden154
Copy link
Contributor Author

It doesn't look like it. #94379 landed with all CI passing despite there being an LLDB failure that the premerge bots then caught. https://lab.llvm.org/staging/#/builders/192/builds/4005

We can do it either way, but I think having the coverage here is important, ideally to coordinate patches between LLDB and libc++.

Copy link
Member

@Michael137 Michael137 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmmm libc++ folks had an issue with this back when we discussed running LLDB tests on libc++ CI. Mainly because of how long they might take to run. That's why we only run the data-formatter tests in the libc++ CI (#88312). But maybe that changed (or maybe I'm misunderstanding this current PR)

@Michael137
Copy link
Member

Oh I see @philnik777 already chimed in.

I think i see what happened.

The test that failed was skipped on Linux for the longest time. I re-enabled it very recently specifically to catch libc++<->LLDB breakages: #157649

But the pre-merge CI on the libc++ PR probably ran without being rebased on that change. So the test was skipped.

I think at this point all the libc++-specific tests in LLDB are run as part of the bootstrapping build

@boomanaiden154
Copy link
Contributor Author

But the pre-merge CI on the libc++ PR probably ran without being rebased on that change. So the test was skipped.

Github actions will run the changes as if they were merged into main, so the branch doesn't need to be rebased. It looks like the CI run was more stale than the landing of that PR though (the CI run was five days old, the PR landed four days ago), so it never picked it up.

If this is running as part of the bootstrapping build, that seems reasonable enough to me. I just want to make sure we aren't missing test coverage for these sorts of changes. This is the second or third time the lldb data formatters for libc++ have broken all of premerge for an extended length of time.

@Michael137
Copy link
Member

It looks like the CI run was more stale than the landing of that PR though (the CI run was five days old, the PR landed four days ago), so it never picked it up.

Agreed

If this is running as part of the bootstrapping build, that seems reasonable enough to me. I just want to make sure we aren't missing test coverage for these sorts of changes. This is the second or third time the lldb data formatters for libc++ have broken all of premerge for an extended length of time.

Pretty sure if we tried relanding #94379, the pre-merge CI would fail on it (would be good to confirm :))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants