From mapreduce-issues-return-29139-apmail-hadoop-mapreduce-issues-archive=hadoop.apache.org@hadoop.apache.org Mon Oct 10 06:18:58 2011 Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 179967DEE for ; Mon, 10 Oct 2011 06:18:58 +0000 (UTC) Received: (qmail 79670 invoked by uid 500); 10 Oct 2011 06:18:57 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 79613 invoked by uid 500); 10 Oct 2011 06:18:56 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 79605 invoked by uid 99); 10 Oct 2011 06:18:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Oct 2011 06:18:54 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Oct 2011 06:18:51 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id E51BE30064E for ; Mon, 10 Oct 2011 06:18:29 +0000 (UTC) Date: Mon, 10 Oct 2011 06:18:29 +0000 (UTC) From: "Prashant Sharma (Commented) (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <728130452.13815.1318227509939.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <2140065802.11828.1317399645607.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (MAPREDUCE-3131) Docs and Scripts for setting up single node MRV2 cluster. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123908#comment-13123908 ] Prashant Sharma commented on MAPREDUCE-3131: -------------------------------------------- Arun, You are right, Adding another set of scripts should have some value more than just starting a cluster without much hassle. I made these scripts because it made sense for me and gave me the feel of all possible options I can break the cluster. And I had all weird(possibly) Ideas like trying out multiple "Single node" Cluster on the same machine and trying out variety of things(like distcp). So, In order to bring in value with a new feature. I have already implemented following(I have not submitted the patch though) : *To setup the cluster home in one step {noformat} ./run.sh prepare {noformat} *Start stop and number of NM or Datanodes. {noformat} ./run.sh -NM -D [start|afresh|stop|kill] {noformat} *Debugging and changing between or choosing between daemons for debugging would be breeze. {noformat} ./run.sh -NM -RM -DN -NN -JH debug {noformat} I will soon submit the patch with much better code quality. I understand the hassle of maintaining a set of badly written code (Specially scripts). Also I have already written some default configs ideal for single node cluster. I liked the naming conventions. Now do you see some value.? I would like to have you people throwing in ideas. :) Thanks > Docs and Scripts for setting up single node MRV2 cluster. > ---------------------------------------------------------- > > Key: MAPREDUCE-3131 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3131 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: documentation, mrv2 > Affects Versions: 0.24.0 > Reporter: Prashant Sharma > Assignee: Prashant Sharma > Priority: Trivial > Labels: documentation, hadoop > Fix For: 0.24.0 > > Attachments: MAPREDUCE-3131.patch, MAPREDUCE-3131.patch > > Original Estimate: 168h > Time Spent: 48h > Remaining Estimate: 120h > > Scripts to run a single node cluster with a default configuration. Takes care of running all the daemons including hdfs and yarn. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira