Skip to content

cmd/cgo/internal/test: seg fault on linux-arm-aws builder #61514

Not planned
@cherrymui

Description

@cherrymui

The dashboard shows cmd/cgo/internal/test seg faults on the linux-arm-aws builder since https://golang.org/cl/508135 . Specifically, it is cmd/cgo/internal/test:static failing. The failure is quite consistent, every commit on the same test. Also the same failure on trybot https://go-review.googlesource.com/c/go/+/320910/3#message-34862db7fe6eb712e5699ce7ab0a7f53aed5a2e5

However, I tried to run all.bash or go tool dist test cmd/cgo/internal/test:static on the linux-arm-aws gomote and it doesn't fail. I double checked that the environment looks the same for gomote and the builder.

It is strange as CL 508135 shouldn't change anything semantically (even the order of sorted items). It is double strange that the failure is not reproducible locally.

Filing an issue to investigate.

Activity

eliben

eliben commented on Jul 21, 2023

@eliben
Member

Thanks for filing the issue, @cherrymui -- this is very odd, indeed.

Could the test be failing sporadically after all (and we get unlucky), maybe running it locally with a high count can hit a failure?

ianlancetaylor

ianlancetaylor commented on Jul 21, 2023

@ianlancetaylor
Contributor

Anything is possible, but the build dashboard shows the test failing consistently since that CL and never before that CL.

cherrymui

cherrymui commented on Jul 21, 2023

@cherrymui
MemberAuthor

I tried running go tool dist test cmd/cgo/internal/test:static in a loop for 100 times and it doesn't fail. I'm now trying to do some experiments with trybots in CL 511978

added
arch-armIssues solely affecting the 32-bit arm architecture.
NeedsInvestigationSomeone must examine and confirm this is a valid issue and not a duplicate of an existing one.
on Jul 21, 2023
added this to the Go1.22 milestone on Jul 21, 2023
cherrymui

cherrymui commented on Jul 24, 2023

@cherrymui
MemberAuthor

Did some experiments on CL 511978. Essentially if I change any function(s) to use old code, like https://go-review.googlesource.com/c/go/+/511978/8/src/sort/sort_impl_go121.go , or https://go-review.googlesource.com/c/go/+/511978/9/src/sort/sort_impl_go121.go , trybot passes. It fails if all functions using new implementation. (They all pass on gomote.)

On the other hand, on the build dashboard it passes again since CL https://go.dev/cl/511837 .

Maybe there is something weird on the builder for that time, or how the test are run on the builder/trybot (bad caching?).

Anyway, closing for now. We can reopen if it occurs again.

locked and limited conversation to collaborators on Jul 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    FrozenDueToAgeNeedsInvestigationSomeone must examine and confirm this is a valid issue and not a duplicate of an existing one.arch-armIssues solely affecting the 32-bit arm architecture.compiler/runtimeIssues related to the Go compiler and/or runtime.

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @eliben@ianlancetaylor@bcmills@gopherbot@cherrymui

        Issue actions

          cmd/cgo/internal/test: seg fault on linux-arm-aws builder · Issue #61514 · golang/go