mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pat Ferrel (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-1643) CLI arguments are not being processed in spark-shell
Date Fri, 06 Mar 2015 00:45:38 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349695#comment-14349695
] 

Pat Ferrel commented on MAHOUT-1643:
------------------------------------

I used the the spark shell methods to change the master to my cluster, for instance. This
should work on the Mahout shell too and is documented. Might be nice to support a few special
ones like MASTER of -D:k=v but isn't strictly required. 

> CLI arguments are not being processed in spark-shell
> ----------------------------------------------------
>
>                 Key: MAHOUT-1643
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1643
>             Project: Mahout
>          Issue Type: Bug
>          Components: CLI, spark
>    Affects Versions: 1.0
>         Environment: spark spark-shell
>            Reporter: Andrew Palumbo
>              Labels: DSL, scala, spark, spark-shell
>             Fix For: 1.0
>
>
> The CLI arguments are not being processed in spark-shell.  Most importantly the spark
options are not being passed to the spark configuration via:
> {code}
> $ mahout spark-shell -D:k=n
> {code}
> The arguments are preserved it through {code}$ bin/mahout{code}There should be a relatively
easy fix either by using the MahoutOptionParser, Scopt or by simply parsing the args array.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message