hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3131) Docs and Scripts for setting up single node MRV2 cluster.
Date Mon, 10 Oct 2011 04:22:29 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123885#comment-13123885

Arun C Murthy commented on MAPREDUCE-3131:

bq. Why do we need more than one datanode and nodeManager in a single node setup.?

Prashanth - we already have docs/scripts for running all of Hadoop on a single cluster - they
are the standard bin/hdfs & bin/yarn scripts.


Now, one possible enhancement is to go through the default values of configs and check which
ones cause it to not work properly on a single node *out of the box*.

If there is none, we declare victory.

If there are some we cannot make default (for e.g. they break tests etc.) we can then check
in a conf/singlenode-hdfs-site.xml and conf/singlenode-yarn-site.xml.


Another enhancement is to check in configs & scripts with which people can run multiple
DataNodes/NodeManagers on a single node so that folks get a feel for a 'real' cluster on a
single machine to test/develop/experience.


I'm happy to have you do either or both of the above.

However, checking in another set of scripts to run a single node install with 1 NN/DN/RM/NN
is just a maintenance overhead.

Makes sense?
> Docs and Scripts for setting up single node MRV2 cluster. 
> ----------------------------------------------------------
>                 Key: MAPREDUCE-3131
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3131
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: documentation, mrv2
>    Affects Versions: 0.24.0
>            Reporter: Prashant Sharma
>            Assignee: Prashant Sharma
>            Priority: Trivial
>              Labels: documentation, hadoop
>             Fix For: 0.24.0
>         Attachments: MAPREDUCE-3131.patch, MAPREDUCE-3131.patch
>   Original Estimate: 168h
>          Time Spent: 48h
>  Remaining Estimate: 120h
> Scripts to run a single node cluster with a default configuration. Takes care of running
all the daemons including hdfs and yarn. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message