32bit OpenBLAS build with 64bit Julia by default on OSX 10.6.8

[cmcbride]

On recent master branch:

[nibbler julia]% cat .git/refs/heads/master
c575520

Julia builds in 64-bit, but OpenBLAS appears to build in 32-bit:

[nibbler julia]% ./julia
ERROR: OpenBLAS was not built with 64bit integer support.
You're seeing this error because Julia was built with USE_BLAS64=1
Please rebuild Julia with USE_BLAS64=0
Quitting.

@ViralBShah Thinks this might be due to gcc. For reference:
[nibbler julia]% gcc --version
i686-apple-darwin10-gcc-4.2.1 (GCC) 4.2.1 (Apple Inc. build 5666) (dot 3)
Copyright (C) 2007 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

[vtjnash]

I'm not certain whether or not that fixes it, or how much you will need to delete to get into a consistent state (maybe just openblas), but I was able to ascertain that openblas expected the compiler name ($CC) to contain either -m32 or -m64 on OS X so this perhaps gets closer to the goal.

[staticfloat]

OpenBLAS has problems with gcc on OSX. If @vtjnash's solution doesn't fix it, what is your version of clang?

[ViralBShah]

Perhaps we switch to using system blas by default on 10.6 as we used to.

[vtjnash]

sigh, upstream bug opened: OpenMathLib/OpenBLAS#265 so that we can revert cbd9c3d once that is closed

[cmcbride]

I think this can be solved by the suggestion of @ViralBShah: revert to using system BLAS in 10.6. It's a minority platform anyhow that will eventually be phased out.

[vtjnash]

Can you post the contents of deps/openblas-v0.2.6/Makefile.conf and deps/openblas-v0.2.6/config.h?

[cmcbride]

OK, I just rechecked (pulled, recompiled without Make.user) and it seemed to work.

julia> versioninfo()
Julia Version 0.2.0-prerelease+2873
Commit 3d28781* 2013-07-29 08:33:53 UTC
Platform Info:
System: Darwin (x86_64-apple-darwin10)
WORD_SIZE: 64
BLAS: libopenblas (USE64BITINT NO_AFFINITY)
LAPACK: libopenblas
LIBM: libopenlibm

I doubt you want to see the openblas config now, but let me know if you do.

[vtjnash]

oh, i guess not then. it seems it was working all along then?

[cmcbride]

Ugh, sorry for the noise. Seems it was a problem with the environment that I missed ruling out.

[nibbler julia]% LD_LIBRARY_PATH="/opt/local/lib" ./julia
ERROR: OpenBLAS was not built with 64bit integer support.
You're seeing this error because Julia was built with USE_BLAS64=1
Please rebuild Julia with USE_BLAS64=0
Quitting.
[nibbler julia]% LD_LIBRARY_PATH="" ./julia
_
_ _ ()_ | A fresh approach to technical computing
() | () () | Documentation: http://docs.julialang.org
_ _ | | __ _ | Type "help()" to list help topics
| | | | | | |/ ` | |
| | || | | | (| | | Version 0.2.0-prerelease+2873
/ |_'|||__'| | Commit 3d28781* 2013-07-29 08:33:53 UTC
|__/ | x86_64-apple-darwin10

The culprit appears to be something in /opt/local/lib (MacPorts) but there is no OpenBLAS there (I checked for other libraries using locate, find, etc initially). The only BLAS in there that I see is libgslcblas.

I'm trying to find the OSX equivalent of strace / ltrace to find out which library julia is trying to load that causes this problem.

[cmcbride]

OK, my OSX dev-foo is weak. If anyone knows how to find which dynamic libraries are being opened (e.g. strace PROG on linux for opened files), I'd be interested to find out.

In any case, I'm a little confused by the following:

diff --git a/base/util.jl b/base/util.jl
index f66e7a0..010570f 100644
--- a/base/util.jl
+++ b/base/util.jl
@@ -237,6 +237,8 @@ function blas_set_num_threads(n::Integer)
 end

 function check_blas()
+    println(blas_vendor())
+    println(openblas_get_config())
     if blas_vendor() == :openblas
         openblas_config = openblas_get_config()
         openblas64 = ismatch(r".*USE64BITINT.*", openblas_config)

Which then leads to this

% ./julia
openblas
USE64BITINT NO_AFFINITY
ERROR: OpenBLAS was not built with 64bit integer support.
You're seeing this error because Julia was built with USE_BLAS64=1
Please rebuild Julia with USE_BLAS64=0
Quitting.

This seems at odds with the logic of the code above, and I am not sure why this works in one case but not another (it works with MacPorts library path removed). Could there be a problem with some library regexp library that ismatch() is using causing this test to fail?

[cmcbride]

Yup, looks like OpenBLAS was a red herring. A PCRE library in MacPorts (pcre 8.3.3) was causing the regex to fail via ismatch() and falsely thinking OpenBLAS was not 64bit capable even when it was.

I'm not sure if this is related to any of the PCRE issues.