mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy Lyubimov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-1489) Interactive Scala & Spark Bindings Shell & Script processor
Date Fri, 11 Apr 2014 03:18:15 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966167#comment-13966167
] 

Dmitriy Lyubimov commented on MAHOUT-1489:
------------------------------------------

[~andrew.musselman] yes. it does that and more. you really perhaps should listen to one of
Matei's Spark talks.

 It is basically a scala shell that aside from  line-by-line scala interpretation, turns all
closures and classes you create on the fly into byte code and ships them to Spark backend
automatically. No other distributed backend that i know is capable of anything comparable.
usually they all require one to compile and ship tons of jars in this situation.

> Interactive Scala & Spark Bindings Shell & Script processor
> -----------------------------------------------------------
>
>                 Key: MAHOUT-1489
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1489
>             Project: Mahout
>          Issue Type: New Feature
>    Affects Versions: 1.0
>            Reporter: Saikat Kanjilal
>            Assignee: Dmitriy Lyubimov
>             Fix For: 1.0
>
>
> Build an interactive shell /scripting (just like spark shell). Something very similar
in R interactive/script runner mode.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message