hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prashant Sharma (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3131) Docs and Scripts for setting up single node MRV2 cluster.
Date Mon, 10 Oct 2011 06:18:29 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123908#comment-13123908

Prashant Sharma commented on MAPREDUCE-3131:


    You are right, Adding another set of scripts should have some value more than just starting
a cluster without much hassle. 

 I made these scripts because it made sense for me and gave me the feel of all possible options
I can break the cluster. And I had all weird(possibly) Ideas like trying out multiple "Single
node"  Cluster on the same machine and trying out variety of things(like distcp). 

  So, In order to bring in value with a new feature. I have already implemented following(I
have not submitted the patch though) :

*To setup the cluster home in one step

 ./run.sh prepare 
*Start stop and number of NM or Datanodes. 

 ./run.sh -NM <No of Nodemanager daemons> -D <No of datanode daemons> [start|afresh|stop|kill]

*Debugging and changing between or choosing between daemons for debugging would be breeze.

 ./run.sh -NM <port no> -RM <port no> -DN <port no> -NN <portno> -JH
<port no> debug

  I will soon submit the patch with much better code quality. I understand the hassle of maintaining
a set of badly written code (Specially scripts). Also I have already written some default
configs ideal for single node cluster. I liked the naming conventions. 

Now do you see some value.? I would like to have you people throwing in ideas. :)


> Docs and Scripts for setting up single node MRV2 cluster. 
> ----------------------------------------------------------
>                 Key: MAPREDUCE-3131
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3131
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: documentation, mrv2
>    Affects Versions: 0.24.0
>            Reporter: Prashant Sharma
>            Assignee: Prashant Sharma
>            Priority: Trivial
>              Labels: documentation, hadoop
>             Fix For: 0.24.0
>         Attachments: MAPREDUCE-3131.patch, MAPREDUCE-3131.patch
>   Original Estimate: 168h
>          Time Spent: 48h
>  Remaining Estimate: 120h
> Scripts to run a single node cluster with a default configuration. Takes care of running
all the daemons including hdfs and yarn. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message