mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy Lyubimov (JIRA)" <>
Subject [jira] [Commented] (MAHOUT-1489) Interactive Scala & Spark Bindings Shell & Script processor
Date Tue, 22 Apr 2014 01:17:15 GMT


Dmitriy Lyubimov commented on MAHOUT-1489:

well the dangerous code is the mahout shell modifications. 

Since there's a lot of code there devoted (in fairly inconsistent way) figuring out Hadoop
setup and its classpath, and spark commands now need to make sure that doesn't happen, while
adding spark jars... it becomes somewhat kludgy and may break MR things. I so far don't see
evidence of that happening but i am not verifying mahout MR commands all the way either.

> Interactive Scala & Spark Bindings Shell & Script processor
> -----------------------------------------------------------
>                 Key: MAHOUT-1489
>                 URL:
>             Project: Mahout
>          Issue Type: New Feature
>    Affects Versions: 1.0
>            Reporter: Saikat Kanjilal
>            Assignee: Dmitriy Lyubimov
>             Fix For: 1.0
>         Attachments: MAHOUT-1489.patch, MAHOUT-1489.patch.1, mahout-spark-shell-running-standalone.png
> Build an interactive shell /scripting (just like spark shell). Something very similar
in R interactive/script runner mode.

This message was sent by Atlassian JIRA

View raw message