Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B947ADD85 for ; Mon, 22 Oct 2012 14:32:36 +0000 (UTC) Received: (qmail 60010 invoked by uid 500); 22 Oct 2012 14:32:32 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 59920 invoked by uid 500); 22 Oct 2012 14:32:32 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 59901 invoked by uid 99); 22 Oct 2012 14:32:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Oct 2012 14:32:31 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [206.47.135.205] (HELO Spam1.prd.mpac.ca) (206.47.135.205) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Oct 2012 14:32:27 +0000 Received: from Spam1.prd.mpac.ca (unknown [127.0.0.1]) by IMSVA80 (Postfix) with ESMTP id 853981D8057 for ; Mon, 22 Oct 2012 10:32:05 -0400 (EDT) Received: from SMAIL1.prd.mpac.ca (unknown [172.29.2.53]) by Spam1.prd.mpac.ca (Postfix) with ESMTP id 419F91D8054 for ; Mon, 22 Oct 2012 10:32:05 -0400 (EDT) Received: from SMAIL1.prd.mpac.ca ([fe80::d548:4221:967c:4cfb]) by SMAIL1.prd.mpac.ca ([fe80::d548:4221:967c:4cfb%16]) with mapi id 14.02.0318.001; Mon, 22 Oct 2012 10:32:04 -0400 From: "Kartashov, Andy" To: "user@hadoop.apache.org" Subject: RE: Differences between YARN and Hadoop Thread-Topic: Differences between YARN and Hadoop Thread-Index: AQHNrW/kEOspUNmaJkyhkMnk48dV0Ze/m+XAgADC7ACABQkQ4A== Date: Mon, 22 Oct 2012 14:32:04 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.29.60.102] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-TM-AS-Product-Ver: IMSVA-8.0.0.1304-6.5.0.1024-19294.007 X-TM-AS-Result: No--23.467-5.0-31-10 X-imss-scan-details: No--23.467-5.0-31-10 X-TM-AS-Result-Xfilter: Match text exemption rules:No X-TMASE-MatchedRID: 1GZI+iG+MtenykMun0J1wlPjo7D4SFg4U3wEIur3jmG7qpOHKudqc59d X84SPOhP0XUBoYFqIK6dvUgMFcWQy5j50ewQ/8wVj5hLPCX3ZdNQCOsAlaxN79zJTBexoG/cp7u eaEkDqTP1o5SkqHQD6hcglY7+3ZaOtkm+9FsBiT/i3aa5wOREEZE+3DCX3uibL8hiViQhXTJIIz NVdisQU++emaO1P4cYDwC3TuY01vHvBMsbD0XgwnZwubmkurW/jLOy13Cgb4/Sgap63qByoVMNB nhvpRZ/PGGHf2CPCr+VSiQntUyEtDchyiq37BQwwvqOGBrge3u1iRiwFpd+bQzvg1/q1MH2LZ9J 9xcDVyFhAskQQbyoQI9Kv9vXBEB+SqYnKOPDAhXD+zmuoPS1/37cGd19dSFd X-Virus-Checked: Checked by ClamAV on apache.org Thanks Harsh, I have been playing with MapReduce v2 (YARN) in pseudo-dist mode and are tr= ying to deploy it now on a cluster. This is what I came across on CD4 websi= te: Is this an up-to-date note? Shall I switch to MapReducev1 (MRv1) instead? QTE Note: Cloudera does not consider the current upstream MRv2 release stable y= et, and it could potentially change in non-backwards-compatible ways. Cloud= era recommends that you use MRv1 unless you have particular reasons for usi= ng MRv2, which should not be considered production-ready. UNQTE -----Original Message----- From: Harsh J [mailto:harsh@cloudera.com] Sent: Friday, October 19, 2012 1:34 AM To: user@hadoop.apache.org Subject: Re: Differences between YARN and Hadoop Andy, "YARN" is NOT "MRv2". That seems to be a major confusion with people thanks= to everyone mixing up the terms. See this small post for a clear differenc= e: http://www.cloudera.com/blog/2012/10/mr2-and-yarn-briefly-explained/ On Fri, Oct 19, 2012 at 3:30 AM, Kartashov, Andy w= rote: > They are not comparable. > > YARN also known as MRv2 is the newer version of MapReduce also known as M= Rv1. > > > > > -----Original Message----- > From: Tom Brown [mailto:tombrown52@gmail.com] > Sent: Thursday, October 18, 2012 4:33 PM > To: user@hadoop.apache.org > Subject: Differences between YARN and Hadoop > > To all, > > I have a few questions regarding YARN (with respect to Hadoop): > > Are YARN and Hadoop separate, or is YARN the successor to Hadoop? > > What are the major conceptual differences between YARN and Hadoop? > > I have further questions, but they may or may not make sense depending on= the answers to the above. > > Thanks in advance! > > Tom Brown > NOTICE: This e-mail message and any attachments are confidential, > subject to copyright and may be privileged. Any unauthorized use, > copying or disclosure is prohibited. If you are not the intended > recipient, please delete and contact the sender immediately. Please > consider the environment before printing this e-mail. AVIS : le > pr=E9sent courriel et toute pi=E8ce jointe qui l'accompagne sont > confidentiels, prot=E9g=E9s par le droit d'auteur et peuvent =EAtre couve= rts > par le secret professionnel. Toute utilisation, copie ou divulgation > non autoris=E9e est interdite. Si vous n'=EAtes pas le destinataire pr=E9= vu > de ce courriel, supprimez-le et contactez imm=E9diatement l'exp=E9diteur. > Veuillez penser =E0 l'environnement avant d'imprimer le pr=E9sent courrie= l -- Harsh J NOTICE: This e-mail message and any attachments are confidential, subject t= o copyright and may be privileged. Any unauthorized use, copying or disclos= ure is prohibited. If you are not the intended recipient, please delete and= contact the sender immediately. Please consider the environment before pri= nting this e-mail. AVIS : le pr=E9sent courriel et toute pi=E8ce jointe qui= l'accompagne sont confidentiels, prot=E9g=E9s par le droit d'auteur et peu= vent =EAtre couverts par le secret professionnel. Toute utilisation, copie = ou divulgation non autoris=E9e est interdite. Si vous n'=EAtes pas le desti= nataire pr=E9vu de ce courriel, supprimez-le et contactez imm=E9diatement l= 'exp=E9diteur. Veuillez penser =E0 l'environnement avant d'imprimer le pr= =E9sent courriel