mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-1529) Finalize abstraction of distributed logical plans from backend operations
Date Mon, 07 Jul 2014 22:03:35 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054211#comment-14054211
] 

Hudson commented on MAHOUT-1529:
--------------------------------

SUCCESS: Integrated in Mahout-Quality #2690 (See [https://builds.apache.org/job/Mahout-Quality/2690/])
MAHOUT-1529: third collection of various edits against private branch (dlyubimov: rev e4ba7887fc6dbf17c3d73f8d4aa1045eeb48d53e)
* spark/src/main/scala/org/apache/mahout/sparkbindings/SparkEngine.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/VectorOps.scala
* spark/src/test/scala/org/apache/mahout/math/decompositions/MathSuite.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/MatrixOps.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/package.scala
* math-scala/src/main/scala/org/apache/mahout/math/scalabindings/RLikeOps.scala
* math-scala/src/main/scala/org/apache/mahout/math/decompositions/package.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/package.scala
* spark/src/main/scala/org/apache/mahout/sparkbindings/blas/package.scala
* math-scala/src/main/scala/org/apache/mahout/math/decompositions/ALS.scala


> Finalize abstraction of distributed logical plans from backend operations
> -------------------------------------------------------------------------
>
>                 Key: MAHOUT-1529
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1529
>             Project: Mahout
>          Issue Type: Improvement
>            Reporter: Dmitriy Lyubimov
>            Assignee: Dmitriy Lyubimov
>             Fix For: 1.0
>
>
> We have a few situations when algorithm-facing API has Spark dependencies creeping in.

> In particular, we know of the following cases:
> -(1) checkpoint() accepts Spark constant StorageLevel directly;-
> -(2) certain things in CheckpointedDRM;-
> -(3) drmParallelize etc. routines in the "drm" and "sparkbindings" package.-
> -(5) drmBroadcast returns a Spark-specific Broadcast object-
> (6) Stratosphere/Flink conceptual api changes.
> *Current tracker:* PR #1 https://github.com/apache/mahout/pull/1 - closed, need new PR
for remaining things once ready.
> *Pull requests are welcome*.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message