mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy Lyubimov (JIRA)" <>
Subject [jira] [Commented] (MAHOUT-1489) Interactive Scala & Spark Bindings Shell & Script processor
Date Fri, 11 Apr 2014 03:18:15 GMT


Dmitriy Lyubimov commented on MAHOUT-1489:

[~andrew.musselman] yes. it does that and more. you really perhaps should listen to one of
Matei's Spark talks.

 It is basically a scala shell that aside from  line-by-line scala interpretation, turns all
closures and classes you create on the fly into byte code and ships them to Spark backend
automatically. No other distributed backend that i know is capable of anything comparable.
usually they all require one to compile and ship tons of jars in this situation.

> Interactive Scala & Spark Bindings Shell & Script processor
> -----------------------------------------------------------
>                 Key: MAHOUT-1489
>                 URL:
>             Project: Mahout
>          Issue Type: New Feature
>    Affects Versions: 1.0
>            Reporter: Saikat Kanjilal
>            Assignee: Dmitriy Lyubimov
>             Fix For: 1.0
> Build an interactive shell /scripting (just like spark shell). Something very similar
in R interactive/script runner mode.

This message was sent by Atlassian JIRA

View raw message