hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prashant Sharma (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3131) Docs and Scripts for setting up single node MRV2 cluster.
Date Sun, 06 Nov 2011 17:04:51 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145044#comment-13145044

Prashant Sharma commented on MAPREDUCE-3131:

Hadoop Mapreduce has many users exploiting its usefulness and simplicity. Some of them are
students(or non industrial users) and need it the power of mapreduce for solving their research
problems or more commonly even more trivial problems(like generating indexes or just run WordCount
;) ).

So was thinking a bit further - if I can make it (very) easy to setup a trivial(unsecured
and with default parameters) cluster(Created by sharing desktops resources - A typical scenario
among students). Our folks will have a by pass to figuring out how to setup. 

There are two approaches to this.
1. make a tar and copy it around. or( Rsync the cluster home)
2. use deb/rpm approach. 

deb and rpm setup will be more ideal but a bit nontrivial to have and will make steps more
cumbersome. But doing without package management simplifies "a few" things.  And since users
of our trivial clusters are less particular about the "Ideal" approach I propose the later.

> Docs and Scripts for setting up single node MRV2 cluster. 
> ----------------------------------------------------------
>                 Key: MAPREDUCE-3131
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3131
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: documentation, mrv2
>    Affects Versions: 0.24.0
>            Reporter: Prashant Sharma
>            Assignee: Prashant Sharma
>            Priority: Trivial
>              Labels: documentation, hadoop
>             Fix For: 0.24.0
>         Attachments: MAPREDUCE-3131.patch, MAPREDUCE-3131.patch, MAPREDUCE-3131.patch,
>   Original Estimate: 168h
>          Time Spent: 96h
>  Remaining Estimate: 72h
> Scripts to run a single node cluster with a default configuration. Takes care of running
all the daemons including hdfs and yarn. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message