mxnet-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Qing Lan <lanking...@live.com>
Subject Re: Make scalapkg fails if USE_BLAS is set to openblas/mkl/apple
Date Wed, 06 Jun 2018 18:21:21 GMT
Hi Pedro,
It came from this line:
https://github.com/apache/incubator-mxnet/blob/master/src/initialize.cc#L44

It brings us no information other than a "segmentation fault : 11". This came from internal
to send an issue if there is a build failure. 

Thanks,
Qing


´╗┐On 6/6/18, 11:17 AM, "Pedro Larroy" <pedro.larroy.lists@gmail.com> wrote:

    Naveen, do you have more information about why the signal handler was
    causing issues for the scala package? This was also failing on my PR
    validation which included backtraces for crashes in CI.
    
    On Wed, Jun 6, 2018 at 6:38 PM, Anton Chernov <mechernov@gmail.com> wrote:
    
    > The problem still persists with make build, so no correlation with the
    > build system.
    >
    > 2018-06-06 15:49 GMT+02:00 Naveen Swamy <mnnaveen@gmail.com>:
    >
    > > I am using make to build
    > >
    > > On Wed, Jun 6, 2018 at 6:47 AM, Anton Chernov <mechernov@gmail.com>
    > wrote:
    > >
    > > > Yes, we have checked that as well, but did not help in our case. I've
    > > > checked out a commit close to 1.1 where it was still working and built
    > it
    > > > with the new ci scripts (using cmake build for armv7) and it failed
    > very
    > > > similar. It seems that the problem might be in the way we are building
    > > the
    > > > library.
    > > >
    > > > Are you using cmake or make for builds?
    > > >
    > > > 2018-06-06 14:47 GMT+02:00 Naveen Swamy <mnnaveen@gmail.com>:
    > > >
    > > > > By the way it turned out the problem was when we used
    > > USE_SIGNAL_HANDLER
    > > > > along with a combination of flags, try removing signal handler and
    > see
    > > if
    > > > > it works
    > > > >
    > > > > > On Jun 6, 2018, at 12:28 AM, Anton Chernov <mechernov@gmail.com>
    > > > wrote:
    > > > > >
    > > > > > Unfortunately, I think this is the same behaviour that we're
    > > observing
    > > > on
    > > > > > Raspberry Pi's. Currently we are bisecting the release to find
the
    > > > > breaking
    > > > > > commit to have an idea what exactly is broken.
    > > > > >
    > > > > > What I can say for now that this failure is not deterministic
(on
    > > > RPi's)
    > > > > > and the library import to python passes in 1 of 4 times. The
    > creation
    > > > of
    > > > > > NDArray's in this case fails though in all cases with similar
    > message
    > > > > that
    > > > > > the stack is corrupted.
    > > > > >
    > > > > > Will update on findings.
    > > > > >
    > > > > > -- Anton
    > > > > >
    > > > > >
    > > > > > 2018-06-05 16:19 GMT+02:00 Pedro Larroy <
    > > pedro.larroy.lists@gmail.com>
    > > > :
    > > > > >
    > > > > >> Could you compile with debug symbols or get a core file?
From this
    > > > > output
    > > > > >> is not clear why the crash is happening.
    > > > > >>
    > > > > >>> On Sun, May 27, 2018 at 10:04 AM, Naveen Swamy <
    > mnnaveen@gmail.com
    > > >
    > > > > wrote:
    > > > > >>>
    > > > > >>> Hi,
    > > > > >>> I am working to publish MXNet-Scala package to maven
and
    > > encountering
    > > > > an
    > > > > >>> issue when trying to build with openblas/mkl/apple. This
is on
    > both
    > > > the
    > > > > >>> master and the 1.2.0 branch? Can some one help with this.
    > > > > >>> make scalapkg fails when it calls the MXNet backend to
get all
    > the
    > > > > APIs ?
    > > > > >>> can someone help here? should I publish with blas disabled?
I
    > have
    > > > > >> already
    > > > > >>> quite a bit of time on this/
    > > > > >>>
    > > > > >>> [INFO]
    > > > > >>> [INFO] Segmentation fault: 11
    > > > > >>> [INFO]
    > > > > >>> [INFO] Stack trace returned 10 entries:
    > > > > >>> [INFO] [bt] (0)
    > > > > >>> /home/ubuntu/mxnet-master/scala-package/init-native/
    > > > > >>> linux-x86_64/target/libmxnet-init-scala-linux-x86_64.so(
    > > > > >>> dmlc::StackTrace[abi:cxx11]()+0x1bc)
    > > > > >>> [0x7f2f04ca58ec]
    > > > > >>> [INFO] [bt] (1)
    > > > > >>> /home/ubuntu/mxnet-master/scala-package/init-native/
    > > > > >>> linux-x86_64/target/libmxnet-init-scala-linux-x86_64.so(+
    > > 0x31d7a4f)
    > > > > >>> [0x7f2f07971a4f]
    > > > > >>> [INFO] [bt] (2) /lib/x86_64-linux-gnu/libc.so.6(+0x354b0)
    > > > > >> [0x7f3096cd24b0]
    > > > > >>> [INFO] [bt] (3)
    > > > > >>> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/
    > > > > >>> libjvm.so(+0x3e4afc)
    > > > > >>> [0x7f3093e0aafc]
    > > > > >>> [INFO] [bt] (4)
    > > > > >>> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/
    > > > > >>> libjvm.so(+0xa239d6)
    > > > > >>> [0x7f30944499d6]
    > > > > >>> [INFO] [bt] (5)
    > > > > >>> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/
    > > > > >>> libjvm.so(+0xa24cdc)
    > > > > >>> [0x7f309444acdc]
    > > > > >>> [INFO] [bt] (6)
    > > > > >>> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/
    > > > > >>> libjvm.so(+0xa24e4c)
    > > > > >>> [0x7f309444ae4c]
    > > > > >>> [INFO] [bt] (7)
    > > > > >>> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/
    > > > > >>> libjvm.so(+0x7c3252)
    > > > > >>> [0x7f30941e9252]
    > > > > >>> [INFO] [bt] (8)
    > > > > >>> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/
    > > > > >>> libjvm.so(+0x5b00d6)
    > > > > >>> [0x7f3093fd60d6]
    > > > > >>> [INFO] [bt] (9)
    > > > > >>> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/
    > > > > >>> libjvm.so(+0x5b2c44)
    > > > > >>> [0x7f3093fd8c44]
    > > > > >>> [INFO]
    > > > > >>> ------------------------------------------------------------
    > > > > ------------
    > > > > >>>
    > > > > >>> [INFO] MXNet Scala Package - Parent .......................
    > > SUCCESS [
    > > > > >>> 1.265 s]
    > > > > >>> [INFO] MXNet Scala Package - Initializer ..................
    > > SUCCESS [
    > > > > >>> 2.215 s]
    > > > > >>> [INFO] MXNet Scala Package - Initializer Native Parent
....
    > > SUCCESS [
    > > > > >>> 0.017 s]
    > > > > >>> [INFO] MXNet Scala Package - Initializer Native Linux-x86_64
    > > SUCCESS
    > > > [
    > > > > >>> 4.417 s]
    > > > > >>> [INFO] MXNet Scala Package - Macros .......................
    > > SUCCESS [
    > > > > >>> 7.083 s]
    > > > > >>> [INFO] MXNet Scala Package - Core .........................
    > > FAILURE [
    > > > > >>> 4.341 s]
    > > > > >>> [INFO] MXNet Scala Package - Native Parent ................
    > SKIPPED
    > > > > >>> [INFO] MXNet Scala Package - Native Linux-x86_64 CPU-only
.
    > SKIPPED
    > > > > >>> [INFO] MXNet Scala Package - Inference ....................
    > SKIPPED
    > > > > >>> [INFO] MXNet Scala Package - Examples .....................
    > SKIPPED
    > > > > >>> [INFO] MXNet Scala Package - Spark ML .....................
    > SKIPPED
    > > > > >>> [INFO] MXNet Scala Package - Full Parent ..................
    > SKIPPED
    > > > > >>> [INFO] MXNet Scala Package - Full Linux-x86_64 CPU-only
...
    > SKIPPED
    > > > > >>>
    > > > > >>> -Naveen
    > > > > >>>
    > > > > >>
    > > > >
    > > >
    > >
    >
    

Mime
View raw message