Skip to content

x/build: bring back "broke the build" notifications #12509

Open
@josharian

Description

@josharian

I monitor the dev.ssa dashboard for build failures, with decreasing frequency these days. It'd be nice to bring back the automatic notification.

cc @bradfitz

Activity

rsc

rsc commented on Oct 23, 2015

@rsc
Contributor

Sure would be nice!

added this to the Go1.6 milestone on Oct 23, 2015
added
Buildersx/build issues (builders, bots, dashboards)
on Oct 30, 2015
bradfitz

bradfitz commented on Oct 30, 2015

@bradfitz
Contributor

@rsc, how is this a Go1.6 issue? It's not released with Go.

In any case, it's not exactly clear how this should work. Should a flake make it fire? Do you need N failures in a row first? What if the N failures in a row are different? How do you detect they're different? Parsing the text?

The easiest thing is to ignore flakes and just say any transition from ok to failure emails.

I suppose the coordinator could poll http://build.golang.org/?mode=json occasionally and post to Gerrit (which emails), since the coordinator already can post to Gerrit. By asking for the data from build.golang.org it would also catch builders like old-style builders like netbsd and solaris, which report directly to build.golang.org.

I'd prefer if people just don't break the build, though, so I've been spending my builder time primarily on making trybots better.

I'm happy to review code to resurrect this, though. I'm not sure where it lives before, or if it even makes sense to reuse any of the code. @adg?

adg

adg commented on Oct 30, 2015

@adg
Contributor

The code is already there in the build dashboard, it's just broken and I
haven't had an opportunity to investigate why.

On 31 October 2015 at 03:25, Brad Fitzpatrick notifications@github.com
wrote:

@rsc https://github.com/rsc, how is this a Go1.6 issue? It's not
released with Go.

In any case, it's not exactly clear how this should work. Should a flake
make it fire? Do you need N failures in a row first? What if the N failures
in a row are different? How do you detect they're different? Parsing the
text?

The easiest thing is to ignore flakes and just say any transition from ok
to failure emails.

I suppose the coordinator could poll http://build.golang.org/?mode=json
occasionally and post to Gerrit (which emails), since the coordinator
already can post to Gerrit. By asking for the data from build.golang.org
it would also catch builders like old-style builders like netbsd and
solaris, which report directly to build.golang.org.

I'd prefer if people just don't break the build, though, so I've been
spending my builder time primarily on making trybots better.

I'm happy to review code to resurrect this, though. I'm not sure where it
lives before, or if it even makes sense to reuse any of the code. @adg
https://github.com/adg?


Reply to this email directly or view it on GitHub
#12509 (comment).

rsc

rsc commented on Dec 5, 2015

@rsc
Contributor

Would still like this, and it would have potentially sped the work on Go 1.6, but too late now and obviously not going to gate Go 1.6.

modified the milestones: Unreleased, Go1.6 on Dec 5, 2015
changed the title [-]build: bring back "broke the build" notifications[/-] [+]x/build: bring back "broke the build" notifications[/+] on Jul 7, 2017
josharian

josharian commented on Mar 28, 2018

@josharian
ContributorAuthor
andybons

andybons commented on Mar 30, 2018

@andybons
Member

Indeed this would be nice.

FiloSottile

FiloSottile commented on May 15, 2018

@FiloSottile
Contributor

This would be useful both for the dev branches and for the subrepos (so we are notified when master breaks x/crypto or x/crypto breaks on 1.9).

self-assigned this
on Dec 14, 2018
added
FeatureRequestIssues asking for a new feature that does not need a proposal.
on Sep 4, 2019
bradfitz

bradfitz commented on Sep 4, 2019

@bradfitz
Contributor

This could even be in cmd/gopherbot (which is easy to hack on locally), looking at the build.golang.org failure results and trying to not spam too early and waiting until it's confident (e.g. make.bash failing is a real failure, but a test failure might be a flake unless we saw in N times in a row).

Look at x/build/cmd/retrybuilds for code that accesses the build.golang.org failure results.

/cc @toothrot

removed their assignment
on Nov 18, 2019
gopherbot

gopherbot commented on Nov 21, 2019

@gopherbot
Contributor

Change https://golang.org/cl/208322 mentions this issue: app/appengine: delete old "broke the build" code

added
NeedsInvestigationSomeone must examine and confirm this is a valid issue and not a duplicate of an existing one.
on Nov 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Buildersx/build issues (builders, bots, dashboards)FeatureRequestIssues asking for a new feature that does not need a proposal.NeedsInvestigationSomeone must examine and confirm this is a valid issue and not a duplicate of an existing one.help wanted

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @bradfitz@josharian@rsc@andybons@FiloSottile

        Issue actions

          x/build: bring back "broke the build" notifications · Issue #12509 · golang/go