mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saikat Kanjilal (JIRA)" <>
Subject [jira] [Commented] (MAHOUT-1489) Interactive Scala & Spark Bindings Shell & Script processor
Date Sun, 06 Apr 2014 23:40:15 GMT


Saikat Kanjilal commented on MAHOUT-1489:

Finally have something compiling:
1) Removed all the un-necessary packages around storage/scheduler and more
2) Trimmed down the code to copy the contents of the spark-shell for now since extending an
object is not possible in scala, one alternative is to create an abstract trait that we could
inherit from, need to talk this through as I want to reuse the spark code as much as possible
3) Moved the ReplSuite into a set of tests called MahoutShellSuite which we'll leverage
4) Added dependencies for various spark components into pom file

Dmitry can you take a look at and
let me know your thoughts on : 1) whether any obvious dependencies are missing in the pom
file 2) whether the initial shell code is missing any pieces

If not I'll be moving forward and fixing the tests to work with the code for the next big
code drop


> Interactive Scala & Spark Bindings Shell & Script processor
> -----------------------------------------------------------
>                 Key: MAHOUT-1489
>                 URL:
>             Project: Mahout
>          Issue Type: New Feature
>    Affects Versions: 1.0
>            Reporter: Saikat Kanjilal
>            Assignee: Dmitriy Lyubimov
>             Fix For: 1.0
> Build an interactive shell /scripting (just like spark shell). Something very similar
in R interactive/script runner mode.

This message was sent by Atlassian JIRA

View raw message