mahout-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Palumbo (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (MAHOUT-2003) Check to see if CUSPARSE library requires sorted CSC format
Date Sun, 16 Jul 2017 00:48:00 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088757#comment-16088757
] 

Andrew Palumbo edited comment on MAHOUT-2003 at 7/16/17 12:47 AM:
------------------------------------------------------------------

It seems that {{CUSPARSE}} {{cusparseDcsrgemm}} requires sorted CSR format.  

Testing with unsorted rows without sorting results in:

{code}
CUDATestSuite:
log4j:WARN No appenders could be found for logger (org.apache.mahout.math.backend.RootSolverFactory$).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Mahout JVM Sparse multiplication time: 1898 ms.
- sparse mmul at geometry of 1000 x 1000 %*% 1000 x 1000 density = .2.  5 runs *** FAILED
***
  jcuda.CudaException: cudaErrorIllegalAddress
  at jcuda.runtime.JCuda.checkResult(JCuda.java:460)
  at jcuda.runtime.JCuda.cudaMemcpy(JCuda.java:4592)
  at org.apache.mahout.cuda.package$.prod(package.scala:311)
  at org.apache.mahout.cuda.CUDATestSuite$.getAverageTimeSparse(CUDATestSuite.scala:68)
  at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply$mcV$sp(CUDATestSuite.scala:14)
  at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply(CUDATestSuite.scala:14)
  at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply(CUDATestSuite.scala:14)
  at org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22)
  at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
  at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
  ...
- sparse mmul at geometry of 1000 x 1000 %*% 1000 x 1000 density = .02.  5 runs *** FAILED
**
{code}


was (Author: andrew_palumbo):
It seems that {{CUSPARSE}} {{cusparseDcsrgemm}} requires sorted CSR format.  

Testing with unsorted crows (transposed into columns) without sorting results in:

{code}
CUDATestSuite:
log4j:WARN No appenders could be found for logger (org.apache.mahout.math.backend.RootSolverFactory$).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Mahout JVM Sparse multiplication time: 1898 ms.
- sparse mmul at geometry of 1000 x 1000 %*% 1000 x 1000 density = .2.  5 runs *** FAILED
***
  jcuda.CudaException: cudaErrorIllegalAddress
  at jcuda.runtime.JCuda.checkResult(JCuda.java:460)
  at jcuda.runtime.JCuda.cudaMemcpy(JCuda.java:4592)
  at org.apache.mahout.cuda.package$.prod(package.scala:311)
  at org.apache.mahout.cuda.CUDATestSuite$.getAverageTimeSparse(CUDATestSuite.scala:68)
  at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply$mcV$sp(CUDATestSuite.scala:14)
  at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply(CUDATestSuite.scala:14)
  at org.apache.mahout.cuda.CUDATestSuite$$anonfun$1.apply(CUDATestSuite.scala:14)
  at org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22)
  at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
  at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
  ...
- sparse mmul at geometry of 1000 x 1000 %*% 1000 x 1000 density = .02.  5 runs *** FAILED
**
{code}

> Check to see if CUSPARSE library requires sorted CSC format   
> --------------------------------------------------------------
>
>                 Key: MAHOUT-2003
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-2003
>             Project: Mahout
>          Issue Type: Test
>    Affects Versions: 0.13.1
>            Reporter: Andrew Palumbo
>            Assignee: Andrew Palumbo
>             Fix For: 0.13.2
>
>
> Test whether CUSPARSE requires sorted CSC(R) if not, it should be an easy win-  to  
 shave some time off of the conversion to compressed format without any sorting.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message