mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <>
Subject [jira] Commented: (MAHOUT-502) Adding footer note to command line utility
Date Fri, 24 Sep 2010 13:59:33 GMT


Hudson commented on MAHOUT-502:

Integrated in Mahout-Quality #320 (See [])

> Adding footer note to command line utility
> ------------------------------------------
>                 Key: MAHOUT-502
>                 URL:
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Utils
>            Reporter: Joe Prasanna Kumar
>            Priority: Trivial
>             Fix For: 0.4
>         Attachments: MAHOUT-502.patch
> Hi all,
> Since ClusterDumper doesnt seem to have elaborate documentation, just created a page
> While playing around with clusterdump utility, I learned that it can be run on hadoop
or as a standalone java program.
> As most of you are aware, when executed on hadoop, the seqFileDir and pointsDir should
be the HDFS location else the local system path location. Since some of the clustering related
wiki pages specified that we can get the output from HDFS and then run clusterdump, I was
assuming that the clusterdump would always read data from local FS.
> I am not sure if newbies would have this same thought process.. So I was thinking if
we'd need to make this explicit by changing the help list of clusterdump
> Currently has 
>  addOption(SEQ_FILE_DIR_OPTION, "s", "The directory containing Sequence Files for the
Clusters", true);
> Should we specify something like
>  addOption(SEQ_FILE_DIR_OPTION, "s", "The directory (HDFS if using Hadoop / Local filesystem
if on standalone mode) containing Sequence Files for the Clusters", true);
> and so on..
> The problem with this approach is itz repetitive in that we'd need to change in quite
a few places.. (I believe vectordump also follows the same principle)
> or 
> should we modify CommandLineUtil to have a generic message in the help specifying the
fact that while running hadoop, the directories should reference HDFS location else local
> How about adding it to the footer like 
> formatter.setFooter("Specify HDFS directories while running hadoop; else specify local
File System directories");
> formatter.printFooter();
> Appreciate your feedbacks / thots.
> thanks
> Joe.
> from	Jeff Eastman <>
> reply-to
> to
> date	Fri, Sep 3, 2010 at 2:45 PM
> subject	Re: ClusterDumper - Hadoop or standalone ?
> mailed-by
> hide details Sep 3 (12 days ago)
> - Show quoted text -
> +1 to generic message approach

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message