Skip to content

x/build/cmd/release: fails for -target=linux-amd64 due to non-default GOROOT_FINAL value causing TestScript/test_race_install_cgo test to fail #39385

Closed
@dmitshur

Description

@dmitshur

Edit: This is an issue for a specific test. See #39386 for the high level tracking issue.

This issue requires investigation. The problem is either in how the release command sets up the environment and executes commands on the builder, or in the builder definition, or in the test, or some combination. Depending on what we learn, we may end up deciding this is okay to resolve after beta1 (but before the final release) and skip this test failure in order to make the Go 1.15 beta 1 available for testing and finding unknown issues sooner.

This can be reproduced (reliably) if your account has permissions needed to run releasebot (they are documented at https://github.com/golang/build/tree/master/cmd/releasebot#permissions) with:

$ release -target=linux-amd64 -version=go1.15beta1 -watch -rev=09e791feb1dfbfc05578a17cd9c035ef82af4033
[...]
ok  	cmd/doc	0.154s
ok  	cmd/fix	4.935s
go test proxy running at GOPROXY=http://127.0.0.1:38583/mod
go proxy: no archive rsc.io v1.5.2: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.1.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.5.1: file does not exist
go proxy: no archive example.com/newcycle v1.0.0: file does not exist
go proxy: no archive test.go v1.0.0: file does not exist
go proxy: no archive rsc.io v1.5.2: file does not exist
--- FAIL: TestScript (0.01s)
    --- FAIL: TestScript/test_race_install_cgo (0.39s)
        script_test.go:209: 
            # Tests Issue #10500 (0.392s)
            > [!race] skip
            > [!darwin] ! stale cmd/cgo  # The darwin builders are spuriously stale; see #33598.
            FAIL: testdata/script/test_race_install_cgo.txt:5: cmd/cgo is unexpectedly stale
            
            
FAIL
FAIL	cmd/go	81.725s
ok  	cmd/go/internal/auth	0.033s
ok  	cmd/go/internal/cache	0.140s
[...]
ok  	cmd/pack	2.172s
ok  	cmd/trace	0.090s
ok  	cmd/vet	12.448s
FAIL
go tool dist: Failed: exit status 1
Complete Output
release $ go run . -target linux-amd64 -watch -version go1.15beta1 -rev 9326d71874730901c159643703a16dc34646e5bd
[... duplicate output from -watch flag]
2020/06/03 10:48:30 linux-amd64: Error: Build failed: exit status 1
Output:
Building Go cmd/dist using /go1.4. (go1.4 linux/amd64)
Building Go toolchain1 using /go1.4.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for linux/amd64.

##### Testing packages.
ok  	archive/tar	0.042s
ok  	archive/zip	0.424s
ok  	bufio	0.122s
ok  	bytes	2.197s
ok  	compress/bzip2	0.082s
ok  	compress/flate	0.920s
ok  	compress/gzip	0.117s
ok  	compress/lzw	0.128s
ok  	compress/zlib	0.791s
ok  	container/heap	0.038s
ok  	container/list	0.040s
ok  	container/ring	0.004s
ok  	context	0.032s
ok  	crypto	0.004s
ok  	crypto/aes	0.027s
ok  	crypto/cipher	0.013s
ok  	crypto/des	0.030s
ok  	crypto/dsa	0.010s
ok  	crypto/ecdsa	0.234s
ok  	crypto/ed25519	0.217s
ok  	crypto/elliptic	0.066s
ok  	crypto/hmac	0.005s
ok  	crypto/internal/subtle	0.006s
ok  	crypto/md5	0.026s
ok  	crypto/rand	0.016s
ok  	crypto/rc4	0.063s
ok  	crypto/rsa	0.145s
ok  	crypto/sha1	0.041s
ok  	crypto/sha256	0.004s
ok  	crypto/sha512	0.013s
ok  	crypto/subtle	0.007s
ok  	crypto/tls	1.332s
ok  	crypto/x509	0.773s
ok  	database/sql	0.667s
ok  	database/sql/driver	0.005s
ok  	debug/dwarf	0.039s
ok  	debug/elf	0.021s
ok  	debug/gosym	0.013s
ok  	debug/macho	0.006s
ok  	debug/pe	0.016s
ok  	debug/plan9obj	0.038s
ok  	encoding/ascii85	0.045s
ok  	encoding/asn1	0.009s
ok  	encoding/base32	0.048s
ok  	encoding/base64	0.007s
ok  	encoding/binary	0.016s
ok  	encoding/csv	0.040s
ok  	encoding/gob	0.025s
ok  	encoding/hex	0.029s
ok  	encoding/json	0.298s
ok  	encoding/pem	0.026s
ok  	encoding/xml	0.039s
ok  	errors	0.012s
ok  	expvar	0.013s
ok  	flag	0.134s
ok  	fmt	0.152s
ok  	go/ast	0.005s
ok  	go/build	0.188s
ok  	go/constant	0.019s
ok  	go/doc	0.070s
ok  	go/format	0.020s
ok  	go/importer	0.136s
ok  	go/internal/gccgoimporter	0.022s
ok  	go/internal/gcimporter	3.142s
ok  	go/internal/srcimporter	7.145s
ok  	go/parser	0.033s
ok  	go/printer	0.339s
ok  	go/scanner	0.012s
ok  	go/token	0.027s
ok  	go/types	1.912s
ok  	hash	0.008s
ok  	hash/adler32	0.020s
ok  	hash/crc32	0.016s
ok  	hash/crc64	0.003s
ok  	hash/fnv	0.012s
ok  	hash/maphash	0.116s
ok  	html	0.008s
ok  	html/template	0.098s
ok  	image	0.140s
ok  	image/color	0.052s
ok  	image/draw	0.070s
ok  	image/gif	0.499s
ok  	image/jpeg	0.396s
ok  	image/png	0.056s
ok  	index/suffixarray	0.316s
ok  	internal/cpu	0.053s
ok  	internal/fmtsort	0.033s
ok  	internal/poll	0.179s
ok  	internal/profile	0.015s
ok  	internal/reflectlite	0.162s
ok  	internal/singleflight	0.032s
ok  	internal/trace	0.088s
ok  	internal/unsafeheader	0.023s
ok  	internal/xcoff	0.019s
ok  	io	0.090s
ok  	io/ioutil	0.007s
ok  	log	0.012s
ok  	log/syslog	1.215s
ok  	math	0.057s
ok  	math/big	2.163s
ok  	math/bits	0.010s
ok  	math/cmplx	0.018s
ok  	math/rand	0.309s
ok  	mime	0.012s
ok  	mime/multipart	0.310s
ok  	mime/quotedprintable	0.024s
ok  	net	9.831s
ok  	net/http	11.624s
ok  	net/http/cgi	0.726s
ok  	net/http/cookiejar	0.064s
ok  	net/http/fcgi	0.039s
ok  	net/http/httptest	0.040s
ok  	net/http/httptrace	0.014s
ok  	net/http/httputil	0.062s
ok  	net/http/internal	0.011s
ok  	net/http/pprof	5.119s
ok  	net/internal/socktest	0.003s
ok  	net/mail	0.006s
ok  	net/rpc	0.026s
ok  	net/rpc/jsonrpc	0.008s
ok  	net/smtp	0.021s
ok  	net/textproto	0.059s
ok  	net/url	0.020s
ok  	os	0.840s
ok  	os/exec	1.290s
ok  	os/signal	2.335s
ok  	os/user	0.004s
ok  	path	0.006s
ok  	path/filepath	0.014s
ok  	plugin	0.020s
ok  	reflect	0.325s
ok  	regexp	0.084s
ok  	regexp/syntax	0.886s
ok  	runtime	86.307s
ok  	runtime/debug	0.102s
ok  	runtime/internal/atomic	0.062s
ok  	runtime/internal/math	0.009s
ok  	runtime/internal/sys	0.036s
ok  	runtime/pprof	6.414s
ok  	runtime/trace	0.863s
ok  	sort	0.197s
ok  	strconv	0.667s
ok  	strings	1.892s
ok  	sync	0.428s
ok  	sync/atomic	0.061s
ok  	syscall	0.075s
ok  	testing	0.330s
ok  	testing/iotest	0.033s
ok  	testing/quick	0.084s
ok  	text/scanner	0.008s
ok  	text/tabwriter	0.031s
ok  	text/template	0.044s
ok  	text/template/parse	0.008s
ok  	time	1.943s
ok  	unicode	0.021s
ok  	unicode/utf16	0.023s
ok  	unicode/utf8	0.005s
ok  	cmd/addr2line	3.328s
ok  	cmd/api	9.369s
ok  	cmd/asm/internal/asm	2.424s
ok  	cmd/asm/internal/lex	0.033s
ok  	cmd/compile	13.557s
ok  	cmd/compile/internal/gc	26.960s
ok  	cmd/compile/internal/logopt	0.858s
ok  	cmd/compile/internal/ssa	0.824s
ok  	cmd/compile/internal/syntax	0.014s
ok  	cmd/compile/internal/test	0.019s [no tests to run]
ok  	cmd/compile/internal/types	0.037s
ok  	cmd/cover	2.595s
ok  	cmd/doc	0.154s
ok  	cmd/fix	4.935s
go test proxy running at GOPROXY=http://127.0.0.1:38583/mod
go proxy: no archive rsc.io v1.5.2: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.1.0: file does not exist
go proxy: no archive rsc.io v1.0.0: file does not exist
go proxy: no archive rsc.io v1.5.1: file does not exist
go proxy: no archive example.com/newcycle v1.0.0: file does not exist
go proxy: no archive test.go v1.0.0: file does not exist
go proxy: no archive rsc.io v1.5.2: file does not exist
--- FAIL: TestScript (0.01s)
    --- FAIL: TestScript/test_race_install_cgo (0.39s)
        script_test.go:209: 
            # Tests Issue #10500 (0.392s)
            > [!race] skip
            > [!darwin] ! stale cmd/cgo  # The darwin builders are spuriously stale; see #33598.
            FAIL: testdata/script/test_race_install_cgo.txt:5: cmd/cgo is unexpectedly stale
            
            
FAIL
FAIL	cmd/go	81.725s
ok  	cmd/go/internal/auth	0.033s
ok  	cmd/go/internal/cache	0.140s
ok  	cmd/go/internal/generate	0.050s
ok  	cmd/go/internal/get	0.047s
ok  	cmd/go/internal/imports	0.020s
ok  	cmd/go/internal/load	0.025s
ok  	cmd/go/internal/lockedfile	0.142s
ok  	cmd/go/internal/lockedfile/internal/filelock	0.063s
ok  	cmd/go/internal/modconv	0.035s
ok  	cmd/go/internal/modfetch	0.033s
ok  	cmd/go/internal/modfetch/codehost	0.023s
ok  	cmd/go/internal/modfetch/zip_sum_test	0.034s
ok  	cmd/go/internal/modload	0.022s
ok  	cmd/go/internal/mvs	0.038s
ok  	cmd/go/internal/par	0.047s
ok  	cmd/go/internal/renameio	0.082s
ok  	cmd/go/internal/search	0.022s
ok  	cmd/go/internal/test	0.060s
ok  	cmd/go/internal/txtar	0.013s
ok  	cmd/go/internal/web	0.035s
ok  	cmd/go/internal/work	0.068s
ok  	cmd/gofmt	0.096s
ok  	cmd/internal/buildid	0.504s
ok  	cmd/internal/dwarf	0.012s
ok  	cmd/internal/edit	0.044s
ok  	cmd/internal/goobj	1.511s
ok  	cmd/internal/goobj2	0.056s
ok  	cmd/internal/moddeps	3.387s
ok  	cmd/internal/obj	0.033s
ok  	cmd/internal/obj/arm64	0.194s
ok  	cmd/internal/obj/ppc64	0.145s
ok  	cmd/internal/obj/riscv	0.162s
ok  	cmd/internal/obj/x86	0.776s
ok  	cmd/internal/objabi	0.033s
ok  	cmd/internal/src	0.029s
ok  	cmd/internal/test2json	0.405s
ok  	cmd/link	25.148s
ok  	cmd/link/internal/benchmark	0.025s
ok  	cmd/link/internal/ld	7.021s
ok  	cmd/link/internal/loader	0.058s
ok  	cmd/link/internal/sym	0.028s
ok  	cmd/nm	6.175s
ok  	cmd/objdump	3.473s
ok  	cmd/oldlink/internal/sym	0.031s
ok  	cmd/pack	2.172s
ok  	cmd/trace	0.090s
ok  	cmd/vet	12.448s
FAIL
go tool dist: Failed: exit status 1

(The release command creates a tarball and places it in a staging directory; it doesn't publish anything, so it is safe to run with -version=go1.15beta1 flag.)

/cc @golang/osp-team @bcmills @jayconrod @matloob

Metadata

Metadata

Assignees

No one assigned

    Labels

    Buildersx/build issues (builders, bots, dashboards)FrozenDueToAgeNeedsFixThe path to resolution is known, but the work has not been done.release-blocker

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions