Return-Path: 
 <user-return-5276-apmail-hadoop-common-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-user-archive@www.apache.org
Delivered-To: apmail-hadoop-common-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 07AF5EE27
	for <apmail-hadoop-common-user-archive@www.apache.org>;
 Wed, 20 Feb 2013 08:10:51 +0000 (UTC)
Received: (qmail 62607 invoked by uid 500); 20 Feb 2013 08:10:45 -0000
Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org
Received: (qmail 62270 invoked by uid 500); 20 Feb 2013 08:10:45 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 62243 invoked by uid 99); 20 Feb 2013 08:10:44 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Feb 2013 08:10:44 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of happygodwithwang@gmail.com
 designates 209.85.217.181 as permitted sender)
Received: from [209.85.217.181] (HELO mail-lb0-f181.google.com)
 (209.85.217.181)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Feb 2013 08:10:38 +0000
Received: by mail-lb0-f181.google.com with SMTP id gm6so5707321lbb.40
        for <user@hadoop.apache.org>; Wed, 20 Feb 2013 00:10:18 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:x-received:in-reply-to:references:date:message-id
         :subject:from:to:content-type;
        bh=aGGm60zMXiOWx7lCETM7AXoWzEqZaV6CIwVlHykzyng=;
        b=CWW2O/z8+Lt7IAdtlVdU42OTfGOAcYS3x35rq423ig82nhx+CppTeZO2XdEjNA9naS
         P3UPEOGcq3X2pgGwWfnxLlYExeRzrkszDJ6S0UgF6jbTYd2k7N6SlfcxLuFyO7jhTKC7
         i5npp3rOhFHAaqdQxQQ+uvfN90hy5VOc1uhUEVkkUyt/U5mIs5IA+BAx4tVoz5cNjnZq
         fGoNDMfnS9khjeJ/lWbyBqf9AExWNDQcXXUX9JnIhOoWriXHtG00OaG11K7GyrRltQoQ
         X7ZxXwpGmpFJYFxHHE5qpL8OcLcPlZnvTdSCxI+x7lMdus6li1KXFyF+wUm551qHfe7u
         Rh2g==
MIME-Version: 1.0
X-Received: by 10.152.146.199 with SMTP id te7mr16715027lab.23.1361347818167;
 Wed, 20 Feb 2013 00:10:18 -0800 (PST)
Received: by 10.114.26.234 with HTTP; Wed, 20 Feb 2013 00:10:17 -0800 (PST)
In-Reply-To: <512382AF.308@lorenzresearch.com>
References: 
 <CAO4U6oSW_rmBDkV7ey_ZeU6SyQpvxHHtAzTydeekrrf_DddSig@mail.gmail.com>
	<512382AF.308@lorenzresearch.com>
Date: Wed, 20 Feb 2013 16:10:17 +0800
Message-ID: 
 <CAO4U6oSqwZL=jqyv9nuta79xKQQx7iqhkXc8kvv-G-Z3ahdCTQ@mail.gmail.com>
Subject: Re: CDH4 version questions
From: jing wang <happygodwithwang@gmail.com>
To: user@hadoop.apache.org, dboyd@lorenzresearch.com
Content-Type: multipart/alternative; boundary=e89a8f22c5551e206304d6237d59
X-Virus-Checked: Checked by ClamAV on apache.org

--e89a8f22c5551e206304d6237d59
Content-Type: text/plain; charset=ISO-8859-1

Hi David,

Thanks for your reply.
Some more questions about installing MRV1 using tarball.
For the link '
https://ccp.cloudera.com/display/SUPPORT/CDH4+Downloadable+Tarballs',
should I intall MRV1 using 'hadoop-0.20-mapreduce-0.20.2+1270' or
'hadoop-2.0.0+556' or both of them (
If you install CDH4 from a tarball, you will install YARN. To install MRv1
as well, install the separate MRv1 tarball (mr1-0.20.2+<n>) alongside the
YARN one (hadoop-2.0.0+<n>).
in '
https://ccp.cloudera.com/display/CDH4DOC/CDH4+Installation#CDH4Installation-WaysToInstallCDH4'
)?

If using 'hadoop-0.20-mapreduce-0.20.2+1270', are the configurations same
like CDH3?
If not, would you please show me some link or docs to install MRV1?


Thanks & Best Regards
Jing Wang

2013/2/19 David Boyd <dboyd@lorenzresearch.com>

> Jing:
>    We are using CDH4.1.1 and CDH3 and the
> base Apache Hadoop on several different efforts.
>
> My best cut at answering your questions is below
> however the CDH lists will likely have better
> information on some of them.
>
>
> On 2/19/2013 3:03 AM, jing wang wrote:
>
>> Hi User,
>>
>>    We're facing the challenge of which hadoop version to choose.
>>    We prefer to CDH4, but have a few qustions:
>>    1.Are MRV1 and MRV2 sharing the  same hdfs?
>>
> YES.
>
>
> If so, can MRV1 upgrade
>
>> to MRV2 smoothly?
>>
> They should but we have not played with MRV2 much yet.
>
>
>     2.If using MRV1, should our m/r code basing CDH3 be changed?
>>
> Some.  You will certainly get deprecated warnings.   Biggest issue
> seems to be getting the right CDH4 libraries in the path.
>
>
>     3.Is MRV1 stable enough to be used in production?
>>
> Yes.  I have been beating on a CDH4 with MRV1 code heavily.
> This includes running the SWIM benchmark with the Facebook
> workload.
>
> Even cloudera does not thing MRV2 is quite stable enough yet.
>
>
>
>>
>> Thanks & best regards,
>> Jing Wang
>>
>>
>>
>>
> --
> ========= mailto:dboyd@lorenzresearch.**com <dboyd@lorenzresearch.com>============
> David W. Boyd
> Vice President, Operations
> Lorenz Research, a Data Tactics corporation
> 7901 Jones Branch, Suite 610
> Mclean, VA 22102
> office:   +1-703-506-3735, ext 308
> fax:     +1-703-506-6703
> cell:     +1-703-402-7908
> ============== http://www.lorenzresearch.com/ ============
>
>
> The information contained in this message may be privileged
> and/or confidential and protected from disclosure.
> If the reader of this message is not the intended recipient
> or an employee or agent responsible for delivering this message
> to the intended recipient, you are hereby notified that any
> dissemination, distribution or copying of this communication
> is strictly prohibited.  If you have received this communication
> in error, please notify the sender immediately by replying to
> this message and deleting the material from any computer.
>
>
>

--e89a8f22c5551e206304d6237d59
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi David,<br><br>Thanks for your reply.<br>Some more questions about instal=
ling MRV1 using tarball.<br>For the link &#39;<a href=3D"https://ccp.cloude=
ra.com/display/SUPPORT/CDH4+Downloadable+Tarballs">https://ccp.cloudera.com=
/display/SUPPORT/CDH4+Downloadable+Tarballs</a>&#39;, should I intall MRV1 =
using &#39;hadoop-0.20-mapreduce-0.20.2+1270&#39; or &#39;hadoop-2.0.0+556&=
#39; or both of them (<br>
If you install CDH4 from a tarball, you will install YARN. To install MRv1 =
as well, install the separate MRv1 tarball (mr1-0.20.2+&lt;n&gt;) alongside=
 the YARN one (hadoop-2.0.0+&lt;n&gt;). <br>in &#39;<a href=3D"https://ccp.=
cloudera.com/display/CDH4DOC/CDH4+Installation#CDH4Installation-WaysToInsta=
llCDH4&#39;">https://ccp.cloudera.com/display/CDH4DOC/CDH4+Installation#CDH=
4Installation-WaysToInstallCDH4&#39;</a>)?<br>
<br>If using &#39;hadoop-0.20-mapreduce-0.20.2+1270&#39;, are the configura=
tions same like CDH3?<br>If not, would you please show me some link or docs=
 to install MRV1?<br><br><br>Thanks &amp; Best Regards<br>Jing Wang<br>
<br><div class=3D"gmail_quote">2013/2/19 David Boyd <span dir=3D"ltr">&lt;<=
a href=3D"mailto:dboyd@lorenzresearch.com" target=3D"_blank">dboyd@lorenzre=
search.com</a>&gt;</span><br><blockquote class=3D"gmail_quote" style=3D"mar=
gin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Jing:<br>
=A0 =A0We are using CDH4.1.1 and CDH3 and the<br>
base Apache Hadoop on several different efforts.<br>
<br>
My best cut at answering your questions is below<br>
however the CDH lists will likely have better<br>
information on some of them.<div class=3D"im"><br>
<br>
On 2/19/2013 3:03 AM, jing wang wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
Hi User,<br>
<br>
=A0 =A0We&#39;re facing the challenge of which hadoop version to choose.<br=
>
=A0 =A0We prefer to CDH4, but have a few qustions:<br>
=A0 =A01.Are MRV1 and MRV2 sharing the =A0same hdfs?<br>
</blockquote></div>
YES.<div class=3D"im"><br>
<br>
If so, can MRV1 upgrade<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
to MRV2 smoothly?<br>
</blockquote></div>
They should but we have not played with MRV2 much yet.<div class=3D"im"><br=
>
<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
=A0 =A02.If using MRV1, should our m/r code basing CDH3 be changed?<br>
</blockquote></div>
Some. =A0You will certainly get deprecated warnings. =A0 Biggest issue<br>
seems to be getting the right CDH4 libraries in the path.<div class=3D"im">=
<br>
<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
=A0 =A03.Is MRV1 stable enough to be used in production?<br>
</blockquote></div>
Yes. =A0I have been beating on a CDH4 with MRV1 code heavily.<br>
This includes running the SWIM benchmark with the Facebook<br>
workload.<br>
<br>
Even cloudera does not thing MRV2 is quite stable enough yet.<div class=3D"=
im"><br>
<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
<br>
<br>
Thanks &amp; best regards,<br>
Jing Wang<br>
<br>
<br>
<br>
</blockquote>
<br></div>
-- <br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D mailto:<a href=3D"mailto:dboyd@lorenzresearch.c=
om" target=3D"_blank">dboyd@lorenzresearch.<u></u>com</a> =3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D<br>
David W. Boyd<br>
Vice President, Operations<br>
Lorenz Research, a Data Tactics corporation<br>
7901 Jones Branch, Suite 610<br>
Mclean, VA 22102<br>
office: =A0 +1-703-506-3735, ext 308<br>
fax: =A0 =A0 +1-703-506-6703<br>
cell: =A0 =A0 +1-703-402-7908<br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D <a href=3D"http://www.lorenzrese=
arch.com/" target=3D"_blank">http://www.lorenzresearch.com/</a> =3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>
<br>
<br>
The information contained in this message may be privileged<br>
and/or confidential and protected from disclosure.<br>
If the reader of this message is not the intended recipient<br>
or an employee or agent responsible for delivering this message<br>
to the intended recipient, you are hereby notified that any<br>
dissemination, distribution or copying of this communication<br>
is strictly prohibited. =A0If you have received this communication<br>
in error, please notify the sender immediately by replying to<br>
this message and deleting the material from any computer.<br>
<br>
<br>
</blockquote></div><br>

--e89a8f22c5551e206304d6237d59--