mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy Lyubimov (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAHOUT-1529) Finalize abstraction of distributed logical plans from backend operations
Date Fri, 16 May 2014 23:56:17 GMT

     [ https://issues.apache.org/jira/browse/MAHOUT-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dmitriy Lyubimov updated MAHOUT-1529:
-------------------------------------

    Description: 
We have a few situations when algorithm-facing API has Spark dependencies creeping in. 

In particular, we know of the following cases:
(1) checkpoint() accepts Spark constant StorageLevel directly;
(2) certain things in CheckpointedDRM;
(3) drmParallelize etc. routines in the "drm" and "sparkbindings" package. 

-(5) drmBroadcast returns a Spark-specific Broadcast object-

*Current tracker:* https://github.com/dlyubimov/mahout-commits/tree/MAHOUT-1529.
*Pull requests are welcome*.

  was:
We have a few situations when algorithm-facing API has Spark dependencies creeping in. 

In particular, we know of the following cases:
(1) checkpoint() accepts Spark constant StorageLevel directly;
(2) certain things in CheckpointedDRM;
(3) drmParallelize etc. routines in the "drm" and "sparkbindings" package. 

+(5) drmBroadcast returns a Spark-specific Broadcast object+

*Current tracker:* https://github.com/dlyubimov/mahout-commits/tree/MAHOUT-1529.
*Pull requests are welcome*.


> Finalize abstraction of distributed logical plans from backend operations
> -------------------------------------------------------------------------
>
>                 Key: MAHOUT-1529
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1529
>             Project: Mahout
>          Issue Type: Improvement
>            Reporter: Dmitriy Lyubimov
>             Fix For: 1.0
>
>
> We have a few situations when algorithm-facing API has Spark dependencies creeping in.

> In particular, we know of the following cases:
> (1) checkpoint() accepts Spark constant StorageLevel directly;
> (2) certain things in CheckpointedDRM;
> (3) drmParallelize etc. routines in the "drm" and "sparkbindings" package. 
> -(5) drmBroadcast returns a Spark-specific Broadcast object-
> *Current tracker:* https://github.com/dlyubimov/mahout-commits/tree/MAHOUT-1529.
> *Pull requests are welcome*.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message