Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 12E06D3B1 for ; Fri, 19 Oct 2012 05:46:33 +0000 (UTC) Received: (qmail 3265 invoked by uid 500); 19 Oct 2012 05:46:29 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 2851 invoked by uid 500); 19 Oct 2012 05:46:28 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 2806 invoked by uid 99); 19 Oct 2012 05:46:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Oct 2012 05:46:26 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.223.176 as permitted sender) Received: from [209.85.223.176] (HELO mail-ie0-f176.google.com) (209.85.223.176) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Oct 2012 05:46:18 +0000 Received: by mail-ie0-f176.google.com with SMTP id k11so150434iea.35 for ; Thu, 18 Oct 2012 22:45:57 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=7n3rtqFbjSF+TLH6d1/dkQ8V4WSEdL7hEiiWenhS90o=; b=kk1Jm8P3iFBMjGsGA7p4LDisXh64rsJgV6Q5b4Z/G4wdLK8zhu8ghkDZUvbuYwf3Kn QtPObYw7ClAVyzyNb2jjoISYmY+SOyZcrN7guc8Maa+S2DNmAH0z1UNCdBL7WEOx0RZ5 fjZp9rDyq7VTWieRrhf9qHH6DGaFp3XqXM12LdojmdV3Iu0fcWzBHx+w5dY7c/nt+xh/ l00cnp7Gn9l4VhzVd+JA/n2hdCFIcKFeNTP7h06d/qAuWKBGqQY+rlfAF6DGcfPNPYB0 TUFjqTYG8DYFwcVw0sfS4MpMSDvTlTZ7MgLWWNBWsevg5HLBRgUePTmvOmgPKEuwZkYN gKoA== Received: by 10.50.151.238 with SMTP id ut14mr124953igb.58.1350625557465; Thu, 18 Oct 2012 22:45:57 -0700 (PDT) MIME-Version: 1.0 Received: by 10.64.77.232 with HTTP; Thu, 18 Oct 2012 22:45:37 -0700 (PDT) In-Reply-To: References: From: Harsh J Date: Fri, 19 Oct 2012 11:15:37 +0530 Message-ID: Subject: Re: Differences between YARN and Hadoop To: user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQnZn8jp0EFPk+Rhz7MM3kkMOuu90GBxi3wlv5bOMIF5LXf0FlPXZRpHft3T2W4gQijp3tkZ X-Virus-Checked: Checked by ClamAV on apache.org First, see what a TLP means, here: http://incubator.apache.org/guides/graduation.html#introduction. Apache Hadoop is a collection of 4 major sub-projects (Common, HDFS, YARN, and MR) presently. The top level directory structure can be found at the SVN location: http://svn.apache.org/repos/asf/hadoop/common/trunk/ MRv2 is a sub-project of Apache Hadoop, not a TLP. MRv2 resides under Hadoop, at http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-mapreduce-project/. YARN is also still a sub-project of Apache Hadoop, not a TLP yet. YARN resides under Hadoop, at http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-yarn-project/ HDFS is also a sub-project of Apache Hadoop, not a TLP. HDFS resides under Hadoop, at http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-hdfs-project/ Hope this clears your confusion :) On Fri, Oct 19, 2012 at 3:58 AM, Tom Brown wrote: > Right now Hadoop seems to refer to the bundle of the MRv1 framework > and HDFS though both can be used independently. Since MRv2 is its own > top level project, where does leave HDFS? > > --Tom > > On Thu, Oct 18, 2012 at 5:01 PM, Ruslan Al-Fakikh wrote: >> Hi >> From the beginning YARN was a part of the Hadoop project. Now it has >> been decided to move it to a top-level apache project. >> So, now there are two ways of running hadoop jobs: >> 1) "Old" hadoop (the current stable thing) >> 2) YARN + MR implementation (the future thing, still not stable AFAIK) >> >> Hope that helps >> >> On Fri, Oct 19, 2012 at 12:33 AM, Tom Brown wrote: >>> To all, >>> >>> I have a few questions regarding YARN (with respect to Hadoop): >>> >>> Are YARN and Hadoop separate, or is YARN the successor to Hadoop? >>> >>> What are the major conceptual differences between YARN and Hadoop? >>> >>> I have further questions, but they may or may not make sense depending >>> on the answers to the above. >>> >>> Thanks in advance! >>> >>> Tom Brown -- Harsh J