Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C19DAE561 for ; Fri, 4 Jan 2013 23:29:31 +0000 (UTC) Received: (qmail 64210 invoked by uid 500); 4 Jan 2013 23:29:26 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 64073 invoked by uid 500); 4 Jan 2013 23:29:26 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 64062 invoked by uid 99); 4 Jan 2013 23:29:26 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Jan 2013 23:29:26 +0000 X-ASF-Spam-Status: No, hits=3.3 required=5.0 tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 98.139.253.105 is neither permitted nor denied by domain of evans@yahoo-inc.com) Received: from [98.139.253.105] (HELO mrout2-b.corp.bf1.yahoo.com) (98.139.253.105) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Jan 2013 23:29:21 +0000 Received: from SP1-EX07CAS04.ds.corp.yahoo.com (sp1-ex07cas04.corp.sp1.yahoo.com [216.252.116.155]) by mrout2-b.corp.bf1.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id r04NSg7W056529 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=FAIL) for ; Fri, 4 Jan 2013 15:28:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com; s=cobra; t=1357342124; bh=YAYF3mRIZ9u9cxi8zPWhvHzDC1uMqzyWWdt9HP/dm0U=; h=From:To:Date:Subject:Message-ID:In-Reply-To:Content-Type: MIME-Version; b=eN5z5L4Y7DB009RiTeHTXIxn3RLdZ0/AOA/1aQVBK6fGzcM8R0w16LEgnoS/rISdI qfP3sjSo6P7WImr82fV6e2z6Vnh4j6SRneHaoQC0BBAaxZo0oPPWklF/UvK1+npJcc StpVbjz2vmwvxNdVOb/nYrZNVFuzxFmU8rjTJFyI= Received: from SP1-EX07VS02.ds.corp.yahoo.com ([216.252.116.135]) by SP1-EX07CAS04.ds.corp.yahoo.com ([216.252.116.158]) with mapi; Fri, 4 Jan 2013 15:28:42 -0800 From: Robert Evans To: "user@hadoop.apache.org" Date: Fri, 4 Jan 2013 15:28:38 -0800 Subject: Re: Instructions on how to run Apache Hadoop 2.0.2-alpha? Thread-Topic: Instructions on how to run Apache Hadoop 2.0.2-alpha? Thread-Index: Ac3q0zsERSPr9Q2QRAWkFtHdehq4Og== Message-ID: In-Reply-To: <50E703A6.6020707@talend.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.2.5.121010 acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_CD0CAB8B1098Fevansyahooinccom_" MIME-Version: 1.0 X-Milter-Version: master.31+4-gbc07cd5+ X-CLX-ID: 342123001 X-Virus-Checked: Checked by ClamAV on apache.org --_000_CD0CAB8B1098Fevansyahooinccom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable It is very long and confusing. Here is my understanding of what happened ev= en though I was not around for all of it. 0.1 - 0.20 was mostly main line development. At that point there was a spl= it and 0.20 was forked to add security, 0.20-security, and also to add in a= ppend support for H-BASE 0.20-append. For a long time these branches were = maintained and has bug fixes added to it while main line development went o= n with 0.21 and 0.22. 0.20-security was merged with 0.20-append and was re= named 1.0. It has continued with bug fixes and some new feature work back = ported from trunk. But development did not stop at 0.22. 0.23 was created to support YARN/MR-= V2. At about the same time 0.24 was made for trunk. When 0.20-security+ap= pend became 1.0, 0.23 became 2.0 and 0.24 became 3.0. We at Yahoo! Have be= en in the process of stabilizing YARN for about a year or so. Because 2.0 = looked like new features were going to continue to go in we decided to keep= 0.23 alive for stabilization purposes while 2.0 continued on. It has sinc= e gotten several new features like HDFS-HA and protocol buffer based RPC fo= r HDFS, and a few new features for YARN/MR. So you can almost think of 0.2= 3 as 2.0--. We hope to move to 2.0 in the near future once it stabilizes a= nd loses the alpha tag, at which point 0.23 would go away. --Bobby Evans From: Glen Mazza > Reply-To: "user@hadoop.apache.org" > Date: Friday, January 4, 2013 10:30 AM To: "user@hadoop.apache.org" > Subject: Re: Instructions on how to run Apache Hadoop 2.0.2-alpha? OK, looking at the Hadoop branches: http://svn.apache.org/viewvc/hadoop/com= mon/branches/ and tags: http://svn.apache.org/viewvc/hadoop/common/tags/, i= t's thankfully not that bad. There is no 0.24 in Hadoop, and the Maven pom files for the 2.0.2-alpha bra= nch indeed say 2.0.2-alpha. The Cloudera article linked to below mentions = 0.24, but it's from 2011 and may have been at a time before the Hadoop team= decided to relabel to 2.0 instead. Looking at this again: http://hadoop.a= pache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/SingleCluster.html= , it appears to provide workable instructions, I'll try again with it. Tha= nks for your assistance. Glen On 01/04/2013 11:17 AM, Chen He wrote: Hi Glen I agree with you. There are many versions and confusing. If you really want= to know, you can check the developing and publishing documents. In 0.23's = document, they must announced how many patches are included, as well as the= 2.0.x. Then you will exactly understand which one is which one. Chen On Fri, Jan 4, 2013 at 6:58 AM, Glen Mazza > wrote: Thanks for your response. That's pretty vital information--I'm not used to= separate development/publication versions. Is the 0.23-->2.0.2 renumberin= g stated anywhere on the Hadoop website or wiki? It's very confusing as pe= ople otherwise think there are three separate branches -- 0.2x.y, 1.x, and = 2.x when there are really just two. Also the releases page: http://hadoop.apache.org/releases.html mentions *bo= th* 0.23.x and 2.0.2 releases -- wouldn't the former be numbered as the lat= ter, if as you're saying, 0.23 is published as 2.0.x? Thanks, Glen On 01/04/2013 07:02 AM, Chen He wrote: 0.24 is the developing version, 2.0.2 is the publication version. 0.23 or above is published as 2.0.x On Fri, Jan 4, 2013 at 5:45 AM, Glen Mazza > wrote: Actually, those instructions are for Hadoop 0.24, not 2.0.2-alpha. Glen On 11/30/2012 03:40 PM, Cristian Cira wrote: Dear Glen, try http://blog.cloudera.com/blog/2011/11/building-and-deploying-mr2/ Cristian Cira Graduate Research Assistant Parallel Architecture and System Laboratory(PASL) Shelby Center 2105 Auburn University, AL 36849 ________________________________________ From: Glen Mazza [gmazza@talend.com] Sent: Friday, November 30, 2012 2:37 PM To: user@hadoop.apache.org Subject: Instructions on how to run Apache Hadoop 2.0.2-alpha? Hi, I was able to run Hadoop 1.0.4 single-node with no difficulty following= these instructions: http://hadoop.apache.org/docs/stable/single_node_setu= p.html . The corresponding page that we're referred to at the bottom of here: http:/= /hadoop.apache.org/docs/current/ for Hadoop 2.0.2 is radically different, h= owever, it doesn't seem to have anything to do with starting Hadoop: http:= //hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/SingleCluster= .html . Is it because I'm looking at the wrong page or is it that Hadoop 2= .0.2 is really so different that the instructions have radically changed? = Is there anything similar to http://hadoop.apache.org/docs/stable/single_no= de_setup.html that will show me how to run Hadoop 2.0.2? Thanks, Glen -- Glen Mazza Talend Community Coders - coders.talend.com blog: www.jroller.com/gmazza -- Glen Mazza Talend Community Coders - coders.talend.com blog: www.jroller.com/gmazza -- Glen Mazza Talend Community Coders - coders.talend.com blog: www.jroller.com/gmazza -- Glen Mazza Talend Community Coders - coders.talend.com blog: www.jroller.com/gmazza --_000_CD0CAB8B1098Fevansyahooinccom_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable
It is very long and conf= using. Here is my understanding of what happened even though I was not arou= nd for all of it.

0.1 - 0.20 was mostly main = line development.  At that point there was a split and 0.20 was forked= to add security, 0.20-security, and also to add in append support for H-BA= SE 0.20-append.  For a long time these branches were maintained and ha= s bug fixes added to it while main line development went on with 0.21 and 0= .22.  0.20-security was merged with 0.20-append and was renamed 1.0. &= nbsp;It has continued with bug fixes and some new feature work back ported = from trunk.

But development did not stop at 0.22. =  0.23 was created to support YARN/MR-V2.  At about the same time = 0.24 was made for trunk.  When 0.20-security+append became 1.0, 0.23 b= ecame 2.0 and 0.24 became 3.0.  We at Yahoo! Have been in the process = of stabilizing YARN for about a year or so.  Because 2.0 looked like n= ew features were going to continue to go in we decided to keep 0.23 alive f= or stabilization purposes while 2.0 continued on.  It has since gotten= several new features like HDFS-HA and protocol buffer based RPC for HDFS, = and a few new features for YARN/MR.  So you can almost think of 0.23 a= s 2.0--.  We hope to move to 2.0 in the near future once it stabilizes= and loses the alpha tag, at which point 0.23 would go away.

=
--Bobby Evans

From: Glen Mazza <g= mazza@talend.com>
Reply-To: "user@hadoop.apache.org" = <user@hadoop.apache.org>= ;
Date: Friday, January 4, 2013= 10:30 AM
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Subject: Re: Instructions on how to run Apache Had= oop 2.0.2-alpha?

OK, looking at the Hadoop branc= hes: http://svn.apache.org/viewvc/hadoop/common/branches/ and tags: http://svn.apache.org/viewvc/hadoop/common/tags/, it's thankfully not t= hat bad. 
There is no 0.24 in Hadoop, and the Maven pom files for the 2.0.2-alpha bra= nch indeed say 2.0.2-alpha.  The Cloudera article linked to below ment= ions 0.24, but it's from 2011 and may have been at a time before the Hadoop= team decided to relabel to 2.0 instead.  Looking at this again: http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/Sin= gleCluster.html, it appears to provide workable instructions, I'll try = again with it.  Thanks for your assistance.

Glen

On 01/04/2013 11:17 AM, Chen He wrote:
Hi Glen

I agree with you. There are m= any versions and confusing. If you really want to know, you can check the d= eveloping and publishing documents. In 0.23's document, they must announced= how many patches are included, as well as the 2.0.x.

<= div>Then you will exactly understand which one is which one.

=
Chen

On Fri, Jan 4, 2013 at = 6:58 AM, Glen Mazza <gmazza@talend.com> wrote:
Thanks for your response.  That's pret= ty vital information--I'm not used to separate development/publication vers= ions.  Is the 0.23-->2.0.2 renumbering stated anywhere on the Hadoo= p website or wiki?  It's very confusing as people otherwise think ther= e are three separate branches -- 0.2x.y, 1.x, and 2.x when there are really = just two. 

Also the releases page: http://hadoop.apache.org/releases.html mentions *both* 0.23.x and 2.0.2= releases -- wouldn't the former be numbered as the latter, if as you're sa= ying, 0.23 is published as 2.0.x?

Thanks,
Glen


On 01/04/2013 07:02 AM, Chen He wrote:
0.24 is the developing version, 2.0.= 2 is the publication version.

0.23 or above is= published as 2.0.x

On Fri, Jan 4, 2013= at 5:45 AM, Glen Mazza <gmazza@talend.com> wrote:
Actually, those instructions are for Hadoop 0.24, not 2.0.2-alph= a.

Glen


On 11/30/2012 03:40 PM, Cristian Cira wrote:
Dear Glen,

try http://blog.cloudera.com/blog/2011/11/building-and-deploying-mr2/
Cristian Cira
Graduate Research Assistant
Parallel Architecture and System Laboratory(PASL)
Shelby Center 2105
Auburn University, AL 36849

________________________________________
From: Glen Mazza [gmazza@talend.com]
Sent: Friday, November 30, 2012 2:37 PM
To: user@hadoop.apache.org
Subject: Instructions on how to run Apache Hadoop 2.0.2-alpha?

Hi, I was able to run Hadoop 1.0.4 single-node with no difficulty following= these instructions:  http://h= adoop.apache.org/docs/stable/single_node_setup.html .

The corresponding page that we're referred to at the bottom of here: http://hadoop.apache.org/docs/current/ for Hadoop 2.0.2 is radically di= fferent, however, it doesn't seem to have anything to do with starting Hado= op:  http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/SingleC= luster.html .  Is it because I'm looking at the wrong page or is it that Hadoop 2= .0.2 is really so different that the instructions have radically changed? &= nbsp;Is there anything similar to http://hadoop.apache.org/docs/stable/single_node_setup.html that will s= how me how to run Hadoop 2.0.2?

Thanks,
Glen

--
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza<http://www.jroller.com/gmazza&g= t;




--
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza




--=20
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza



--=20
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza
 --_000_CD0CAB8B1098Fevansyahooinccom_--