failure of --sysimage=x test with threads enabled #41977
Description
Multiple attempts to build and test julia 1.6.2 from source on macOS have resulted in successful builds but recurrent test failures for cmdlineargs.jl. I'm unsure of the significance of these failures. Are they trivial? Should they preclude use of this julia build? There is also a Sockets.jl test failure, but this has been reported in #36986.
macOS Catalina 10.15.7
% gmake --version 17:14
GNU Make 4.3
Built for x86_64-apple-darwin19.2.0
Copyright (C) 1988-2020 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
% git branch 17:20
* backports-release-1.6
_
_ _ _(_)_ | Documentation: https://docs.julialang.org
(_) | (_) (_) |
_ _ _| |_ __ _ | Type "?" for help, "]?" for Pkg help.
| | | | | | |/ _` | |
| | |_| | | | (_| | | Version 1.6.2-pre.100 (2021-08-11)
_/ |\__'_|_|_|\__'_| | backports-release-1.6/d199e03e04 (fork: 433 commits, 257 days)
|__/ |
julia> versioninfo()
Julia Version 1.6.2-pre.100
Commit d199e03e04 (2021-08-11 15:37 UTC)
Platform Info:
OS: macOS (x86_64-apple-darwin19.6.0)
CPU: Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-11.0.1 (ORCJIT, skylake)
Environment:
JULIA_NUM_THREADS = 8
JULIA_EDITOR = Emacs
Test Summary: | Pass Fail Error Broken Total
Overall | 38798217 6 1 352626 39150850
LinearAlgebra/schur | 430 430
LinearAlgebra/eigen | 422 422
LinearAlgebra/lapack | 800 800
LinearAlgebra/bunchkaufman | 5285 5285
LinearAlgebra/tridiag | 1418 1418
LinearAlgebra/svd | 525 525
LinearAlgebra/generic | 530 530
LinearAlgebra/pinv | 288 288
LinearAlgebra/blas | 687 687
LinearAlgebra/adjtrans | 313 313
LinearAlgebra/givens | 1847 1847
LinearAlgebra/ldlt | 8 8
LinearAlgebra/qr | 4531 4531
LinearAlgebra/factorization | 51 18 69
LinearAlgebra/uniformscaling | 510 510
compiler/validation | 26 26
compiler/ssair | 38 38
compiler/irpasses | 22 22
LinearAlgebra/lq | 3005 3005
ambiguous | 101 2 103
compiler/inline | 41 1 42
compiler/codegen | 146 146
compiler/contextual | 6 6
compiler/inference | 888 1 889
strings/search | 692 692
strings/util | 461 461
strings/io | 12751 12751
unicode/utf8 | 19 19
strings/basic | 87674 87674
LinearAlgebra/cholesky | 2406 2406
strings/types | 2302691 2302691
LinearAlgebra/hessenberg | 403 403
worlds | 83 83
LinearAlgebra/special | 3159 3159
triplequote | 29 29
keywordargs | 151 151
intrinsics | 90 90
char | 1529 1529
iobuffer | 204 204
LinearAlgebra/lu | 1287 1287
staged | 64 64
hashing | 12356 12356
LinearAlgebra/structuredbroadcast | 646 646
tuple | 578 578
subtype | 337653 16 337669
dict | 144409 144409
reduce | 8545 8545
simdloop | 249 249
intfuncs | 215864 215864
offsetarray | 465 3 468
vecelement | 678 678
copy | 532 532
core | 8445873 4 8445877
LinearAlgebra/dense | 7881 7881
numbers | 1578565 1 1578566
reducedim | 817 817
fastmath | 934 934
LinearAlgebra/bidiag | 3597 3597
functional | 95 95
rational | 98622 1 98623
path | 357 12 369
ordering | 35 35
operators | 12949 12949
parse | 16094 16094
gmp | 2315 2315
backtrace | 35 1 36
exceptions | 70 70
spawn | 206 4 210
file | 1038 1038
LinearAlgebra/symmetric | 2744 2744
version | 2452 2452
namedtuple | 194 1 195
LinearAlgebra/diagonal | 2632 2632
math | 1520143 1520143
floatapprox | 49 49
LinearAlgebra/matmul | 1028 1028
abstractarray | 54778 24795 79573
arrayops | 1978 2 1980
mpfr | 1135 1135
sysinfo | 4 4
reflection | 403 403
regex | 114 114
env | 74 74
mod2pi | 80 80
euler | 12 12
combinatorics | 170 170
complex | 8429 5 8434
rounding | 112720 112720
client | 3 3
goto | 19 19
llvmcall | 19 19
llvmcall2 | 7 7
ryu | 31215 31215
float16 | 235 235
some | 65 65
meta | 64 64
stacktraces | 48 48
read | 3143 3143
ccall | 5331 5331
loading | 163842 163842
errorshow | 218 218
docs | 226 226
binaryplatforms | 341 341
enums | 99 99
atexit | 40 40
interpreter | 3 3
bitset | 195 195
int | 524668 524668
boundscheck | No tests
sets | 3518 1 3519
osutils | 42 42
error | 31 31
checked | 1239 1239
misc | 1282129 1282129
iostream | 50 50
secretbuffer | 27 27
specificity | 175 175
cartesian | 234 3 237
corelogging | 231 231
syntax | 1400 1 1401
smallarrayshrink | 36 36
show | 1520 8 1528
asyncmap | 292 292
channels | 237 237
ranges | 12109694 327693 12437387
reinterpretarray | 226 226
missing | 472 1 473
Dates/query | 1004 1004
Dates/adjusters | 3149 3149
Dates/accessors | 7723858 7723858
Dates/rounding | 315 315
broadcast | 480 480
Dates/types | 232 232
Dates/arithmetic | 377 377
Dates/periods | 945 945
Dates/conversions | 161 161
sorting | 12709 10 12719
Dates/io | 325 325
CRC32c | 664 664
Dates/ranges | 350637 350637
CompilerSupportLibraries_jll | 4 4
Base64 | 2022 2022
ArgTools | 180 180
Future | No tests
Artifacts | 1449 1449
GMP_jll | 1 1
DelimitedFiles | 89 89
subarray | 318299 318299
LibCURL_jll | 1 1
LibCURL | 6 6
LazyArtifacts | 4 4
LibSSH2_jll | No tests
LibGit2_jll | 2 2
LibUV_jll | 1 1
LibOSXUnwind_jll | 1 1
LibUnwind_jll | No tests
MPFR_jll | 1 1
Libdl | 192 1 193
MbedTLS_jll | 1 1
Logging | 39 39
MozillaCACerts_jll | 1 1
NetworkOptions | 3518 3518
OpenBLAS_jll | 1 1
FileWatching | 510 510
Markdown | 252 252
OpenLibm_jll | 1 1
PCRE2_jll | 2 2
InteractiveUtils | 253 253
Mmap | 139 139
iterators | 10067 10067
Profile | 24 24
Downloads | 212 212
Sockets | 165 1 166
Printf | 996 996
Serialization | 119 1 120
SuiteSparse_jll | 1 1
bitarray | 915190 915190
REPL | 1242 3 1245
UUIDs | 1029 1029
TOML | 415 8 423
Zlib_jll | 1 1
dSFMT_jll | 1 1
libLLVM_jll | 1 1
nghttp2_jll | 1 1
p7zip_jll | 1 1
Unicode | 758 758
Random | 203266 203266
LibGit2/libgit2 | 752 752
Test | 336 14 350
Statistics | 752 752
Tar | 2688 11 2699
floatfuncs | 193 193
cmdlineargs | 239 6 3 248
SparseArrays/higherorderfns | 7120 1 7121
SHA | 1 1
SuiteSparse | 878 878
LinearAlgebra/triangular | 37696 37696
SparseArrays/sparsevector | 10298 10298
SparseArrays/sparse | 3823 3823
LinearAlgebra/addmul | 10224 10224
precompile | 116 116
SharedArrays | 114 114
threads | 1 1
Distributed | 12 12
stress | 118 118
FAILURE
The global RNG seed was 0xa09b1707d54fb3daa5f628ba9f1ae9f4.
Error in testset Sockets:
Error During Test at /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Sockets/test/runtests.jl:394
Got exception outside of a @test
timeout
Stacktrace:
[1] error(s::String)
@ Base ./error.jl:33
[2] (::Main.Test22Main_Sockets.var"#wait_with_timeout#35")(recvs::Vector{Task}, TIMEOUT_VAL::Float64)
@ Main.Test22Main_Sockets /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Sockets/test/runtests.jl:413
[3] (::Main.Test22Main_Sockets.var"#wait_with_timeout#35")(recvs::Vector{Task})
@ Main.Test22Main_Sockets /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Sockets/test/runtests.jl:407
[4] macro expansion
@ /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Sockets/test/runtests.jl:425 [inlined]
[5] macro expansion
@ /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Test/src/Test.jl:1151 [inlined]
[6] top-level scope
@ /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Sockets/test/runtests.jl:395
[7] include
@ ./Base.jl:386 [inlined]
[8] macro expansion
@ /Volumes/ssd500/julia/test/testdefs.jl:24 [inlined]
[9] macro expansion
@ /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Test/src/Test.jl:1151 [inlined]
[10] macro expansion
@ /Volumes/ssd500/julia/test/testdefs.jl:23 [inlined]
[11] macro expansion
@ ./timing.jl:368 [inlined]
[12] runtests(name::String, path::String, isolate::Bool; seed::UInt128)
@ Main /Volumes/ssd500/julia/test/testdefs.jl:21
[13] (::Distributed.var"#106#108"{Distributed.CallMsg{:call_fetch}})()
@ Distributed /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Distributed/src/process_messages.jl:278
[14] run_work_thunk(thunk::Distributed.var"#106#108"{Distributed.CallMsg{:call_fetch}}, print_error::Bool)
@ Distributed /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Distributed/src/process_messages.jl:63
[15] macro expansion
@ /Volumes/ssd500/julia/usr/share/julia/stdlib/v1.6/Distributed/src/process_messages.jl:278 [inlined]
[16] (::Distributed.var"#105#107"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})()
@ Distributed ./task.jl:411
Error in testset cmdlineargs:
Test Failed at /Volumes/ssd500/julia/test/cmdlineargs.jl:599
Expression: !(Base.process_signaled(p))
Error in testset cmdlineargs:
Test Failed at /Volumes/ssd500/julia/test/cmdlineargs.jl:600
Expression: p.exitcode == 1
Evaluated: 0 == 1
Error in testset cmdlineargs:
Test Failed at /Volumes/ssd500/julia/test/cmdlineargs.jl:599
Expression: !(Base.process_signaled(p))
Error in testset cmdlineargs:
Test Failed at /Volumes/ssd500/julia/test/cmdlineargs.jl:600
Expression: p.exitcode == 1
Evaluated: 0 == 1
Error in testset cmdlineargs:
Test Failed at /Volumes/ssd500/julia/test/cmdlineargs.jl:610
Expression: !(Base.process_signaled(p))
Error in testset cmdlineargs:
Test Failed at /Volumes/ssd500/julia/test/cmdlineargs.jl:611
Expression: p.exitcode == 1
Evaluated: 0 == 1
ERROR: LoadError: Test run finished with errors
in expression starting at /Volumes/ssd500/julia/test/runtests.jl:84
gmake[1]: *** [Makefile:25: all] Error 1
gmake: *** [Makefile:530: test] Error 2
Metadata
Metadata
Assignees
Type
Projects
Milestone
Relationships
Development
No branches or pull requests
Participants
Activity
[-]cmdlineargs.jl test failure (macOS)[/-][+]cmdlineargs.jl test failure (macOS) label:test[/+][-]cmdlineargs.jl test failure (macOS) label:test[/-][+]cmdlineargs.jl test failure (macOS)[/+]vtjnash commentedon Aug 24, 2021
It is not significant, but sounds odd. Could you try running that test in isolation? e.g.:
George9000 commentedon Aug 25, 2021
From the root of the
juliabuild directory:vtjnash commentedon Aug 25, 2021
Are you familiar enough with lldb to run with
lldb -- ./usr/bin/julia --sysimage=pwd/nonexistentand get a backtrace?DilumAluthge commentedon Aug 25, 2021
This looks like the same cmdlineargs test failures I am seeing on Buildkite. E.g. https://buildkite.com/julialang/julia-master/builds/2666#741b51f6-640a-472f-b1b7-18c4b9ce0b1e:
George9000 commentedon Aug 25, 2021
Not at all familiar with lldb, but I gave it a go.
vtjnash commentedon Aug 25, 2021
Ah, MWE:
[-]cmdlineargs.jl test failure (macOS)[/-][+]failure of --sysimage=x test with threads enabled[/+]--sysimagecode paths both with and without other command-line flags #42014cmdlineargstests on Buildkite #42118