mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-1934) OpenMP jars aren't being picked up in distributed Spark
Date Thu, 02 Feb 2017 23:07:52 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850703#comment-15850703
] 

Hudson commented on MAHOUT-1934:
--------------------------------

SUCCESS: Integrated in Jenkins build Mahout-Quality #3414 (See [https://builds.apache.org/job/Mahout-Quality/3414/])
[MAHOUT-1934],[MAHOUT-1911]: Clean up getMahoutContext() and surroundnig (apalumbo: rev 991583abf6534a0a7118bfea3af60bf3170397d3)
* (edit) spark/src/main/scala/org/apache/mahout/sparkbindings/package.scala


> OpenMP jars aren't being picked up in distributed Spark
> -------------------------------------------------------
>
>                 Key: MAHOUT-1934
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1934
>             Project: Mahout
>          Issue Type: Improvement
>    Affects Versions: 0.13.0
>            Reporter: Trevor Grant
>            Assignee: Andrew Palumbo
>            Priority: Blocker
>             Fix For: 0.13.0
>
>
> When executing the following:
> ```
> import org.apache.mahout.math.decompositions._
> drmX.checkpoint() 
> val (U, V, s) = dspca(drmX, k = 30, q = 1)
> ```
> I see the following:
> ```
> import org.apache.mahout.math.decompositions._
> res1: org.apache.mahout.math.drm.CheckpointedDrm[Int] = org.apache.mahout.sparkbindings.drm.CheckpointedDrmSpark@2e8dd198
> [INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
> [WARN] Unable to create class GPUMMul: attempting OpenMP version
> [INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
> org.apache.mahout.viennacl.openmp.OMPMMul$
> [INFO] Unable to create class OMPMMul: falling back to java version
> drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] = 
> OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
> ```
> The code executes fine, but it seems the OpenMP is not getting picked up.
> To be clear I build these jars with -Pviennacl-omp
> I the issue persists through other operations as well.  I am running on a 3 node Yarn
cluster/ spark 1.6.3



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message