systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias Boehm (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SYSTEMML-2382) Concurrent problem about LibMatrixMult
Date Wed, 13 Jun 2018 01:21:00 GMT

    [ https://issues.apache.org/jira/browse/SYSTEMML-2382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16510494#comment-16510494
] 

Matthias Boehm commented on SYSTEMML-2382:
------------------------------------------

Ok thanks for the details. I was still not able to reproduce this on a box with 80 virtual
cores and various configurations for k. However, I believe the stacktrace is sufficient. The
previous patch essentially fixed the upper bound check for {{k1<apos+alen}} but corrupted
the lower bound check and hence {{b.isContiguous(aix[k1], aix[k2-1])}} was running out of
bounds with -1 for k1=k2=0. 

> Concurrent problem about LibMatrixMult
> --------------------------------------
>
>                 Key: SYSTEMML-2382
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-2382
>             Project: SystemML
>          Issue Type: Sub-task
>            Reporter: LI Guobao
>            Assignee: LI Guobao
>            Priority: Major
>             Fix For: SystemML 1.2
>
>
> When the worker number is set to 2 and each worker has 2 threads to launch its instruction,
in the case of small batchsize, the program fails with a concurrent error. But when I set
only 1 thread to each worker, everything works fine. By the way, the number of vcore is 4
on my machine.
> Here is the stack:
> {code:java}
> Caused by: org.apache.sysml.runtime.DMLRuntimeException: java.util.concurrent.ExecutionException:
java.lang.ArrayIndexOutOfBoundsException: 3
> at org.apache.sysml.runtime.matrix.data.LibMatrixMult.matrixMult(LibMatrixMult.java:221)
> at org.apache.sysml.runtime.matrix.data.MatrixBlock.aggregateBinaryOperations(MatrixBlock.java:4796)
> at org.apache.sysml.runtime.instructions.cp.AggregateBinaryCPInstruction.processInstruction(AggregateBinaryCPInstruction.java:73)
> at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:252)
> ... 13 more
> Caused by: java.util.concurrent.ExecutionException: java.lang.ArrayIndexOutOfBoundsException:
3
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at org.apache.sysml.runtime.matrix.data.LibMatrixMult.matrixMult(LibMatrixMult.java:213)
> ... 16 more
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 3
> at org.apache.sysml.runtime.matrix.data.LibMatrixMult.matrixMultSparseDenseMMShortLHS(LibMatrixMult.java:1305)
> at org.apache.sysml.runtime.matrix.data.LibMatrixMult.matrixMultSparseDense(LibMatrixMult.java:1194)
> at org.apache.sysml.runtime.matrix.data.LibMatrixMult.access$300(LibMatrixMult.java:57)
> at org.apache.sysml.runtime.matrix.data.LibMatrixMult$MatrixMultTask.call(LibMatrixMult.java:3921)
> ... 5 more
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message