hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prashant Sharma (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3131) Docs and Scripts for setting up single node MRV2 cluster.
Date Mon, 10 Oct 2011 06:18:29 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123908#comment-13123908
] 

Prashant Sharma commented on MAPREDUCE-3131:
--------------------------------------------

Arun,

    You are right, Adding another set of scripts should have some value more than just starting
a cluster without much hassle. 

 I made these scripts because it made sense for me and gave me the feel of all possible options
I can break the cluster. And I had all weird(possibly) Ideas like trying out multiple "Single
node"  Cluster on the same machine and trying out variety of things(like distcp). 

  So, In order to bring in value with a new feature. I have already implemented following(I
have not submitted the patch though) :

*To setup the cluster home in one step

{noformat}
 ./run.sh prepare 
{noformat}
  
*Start stop and number of NM or Datanodes. 

{noformat}
 ./run.sh -NM <No of Nodemanager daemons> -D <No of datanode daemons> [start|afresh|stop|kill]
{noformat}

*Debugging and changing between or choosing between daemons for debugging would be breeze.


{noformat}
 ./run.sh -NM <port no> -RM <port no> -DN <port no> -NN <portno> -JH
<port no> debug
{noformat}

  I will soon submit the patch with much better code quality. I understand the hassle of maintaining
a set of badly written code (Specially scripts). Also I have already written some default
configs ideal for single node cluster. I liked the naming conventions. 

Now do you see some value.? I would like to have you people throwing in ideas. :)

Thanks




                
> Docs and Scripts for setting up single node MRV2 cluster. 
> ----------------------------------------------------------
>
>                 Key: MAPREDUCE-3131
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3131
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: documentation, mrv2
>    Affects Versions: 0.24.0
>            Reporter: Prashant Sharma
>            Assignee: Prashant Sharma
>            Priority: Trivial
>              Labels: documentation, hadoop
>             Fix For: 0.24.0
>
>         Attachments: MAPREDUCE-3131.patch, MAPREDUCE-3131.patch
>
>   Original Estimate: 168h
>          Time Spent: 48h
>  Remaining Estimate: 120h
>
> Scripts to run a single node cluster with a default configuration. Takes care of running
all the daemons including hdfs and yarn. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message