Return-Path: 
 <user-return-10639-apmail-hadoop-mapreduce-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1CE2B101AF
	for <apmail-hadoop-mapreduce-user-archive@minotaur.apache.org>;
 Fri,  6 Sep 2013 00:51:30 +0000 (UTC)
Received: (qmail 12213 invoked by uid 500); 6 Sep 2013 00:51:25 -0000
Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org
Received: (qmail 12108 invoked by uid 500); 6 Sep 2013 00:51:25 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 12101 invoked by uid 99); 6 Sep 2013 00:51:25 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Sep 2013 00:51:25 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of cembree@gmail.com designates
 209.85.214.172 as permitted sender)
Received: from [209.85.214.172] (HELO mail-ob0-f172.google.com)
 (209.85.214.172)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Sep 2013 00:51:21 +0000
Received: by mail-ob0-f172.google.com with SMTP id er7so2805214obc.17
        for <user@hadoop.apache.org>; Thu, 05 Sep 2013 17:51:00 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:reply-to:in-reply-to:references:date:message-id
         :subject:from:to:content-type;
        bh=jsmtssxjbFG5nv1SpsrIhVL3mYo3mmoxRu5FcP/kbcU=;
        b=XZKBt+KLpKPDIthMqV9T8AEtlZ3RtNPm0kLaRxcMmV54NMeSoPaRE7QHZ1SJqQ3/tP
         vdIIRxZCs88Ms9rcvQK8CvXrMwg0t95dLl1hvAU+DWKqCO5YTFfASOZm9m29rXgXkbdt
         i62SL+U9QpQ6WxZ4lxQr5bqotzC9qiS544AaXwjgHseQTWLnOHl/EAKvJAGeGUkdYVH4
         ZhLxNOtKVZ4dm58QnA6LqWlxFQVJ7O3wR01Wkjg6SsmI8JSK2bGOS9E5bNAiAMGvB51K
         adsAOvrJJKSuL3L/To8x4YjGgL29Pc7igBXaY2oN+YHIloRhoJfOr28yiy5xpwzUsP8I
         eUUw==
MIME-Version: 1.0
X-Received: by 10.182.106.4 with SMTP id gq4mr8669943obb.4.1378428660202; Thu,
 05 Sep 2013 17:51:00 -0700 (PDT)
Received: by 10.76.96.105 with HTTP; Thu, 5 Sep 2013 17:51:00 -0700 (PDT)
Reply-To: chris@embree.us
In-Reply-To: <522924C9.70104@cse.ohio-state.edu>
References: <522924C9.70104@cse.ohio-state.edu>
Date: Thu, 5 Sep 2013 20:51:00 -0400
Message-ID: 
 <CADokdcM-RmkF7vSQQbDbAXP+SZSxLYx-umuXTnJXp93xh=7MsA@mail.gmail.com>
Subject: Re: How to speed up Hadoop?
From: Chris Embree <cembree@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8fb1fa62a3c3ae04e5ac6eba
X-Virus-Checked: Checked by ClamAV on apache.org

--e89a8fb1fa62a3c3ae04e5ac6eba
Content-Type: text/plain; charset=ISO-8859-1

I think you just went backwards.   more replicas (generally speaking) are
better.

I'd take 60 cheap, 1 U servers over 20 "highly fault tolerant" ones for
almost every problem.  I'd get them for the same or less $ too.




On Thu, Sep 5, 2013 at 8:41 PM, Sundeep Kambhampati <
kambhamp@cse.ohio-state.edu> wrote:

> Hi all,
>
>     I am looking for ways to configure Hadoop inorder to speed up data
> processing. Assuming all my nodes are highly fault tolerant, will making
> data replication factor 1 speed up the processing? Are there some way to
> disable failure monitoring done by Hadoop?
>
> Thank you for your time.
>
> -Sundeep
>

--e89a8fb1fa62a3c3ae04e5ac6eba
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I think you just went backwards. =A0 more replicas (genera=
lly speaking) are better.<div><br></div><div style>I&#39;d take 60 cheap, 1=
 U servers over 20 &quot;highly fault tolerant&quot; ones for almost every =
problem. =A0I&#39;d get them for the same or less $ too.</div>
<div style><br></div><div style><br></div></div><div class=3D"gmail_extra">=
<br><br><div class=3D"gmail_quote">On Thu, Sep 5, 2013 at 8:41 PM, Sundeep =
Kambhampati <span dir=3D"ltr">&lt;<a href=3D"mailto:kambhamp@cse.ohio-state=
.edu" target=3D"_blank">kambhamp@cse.ohio-state.edu</a>&gt;</span> wrote:<b=
r>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Hi all,<br>
<br>
=A0 =A0 I am looking for ways to configure Hadoop inorder to speed up data =
processing. Assuming all my nodes are highly fault tolerant, will making da=
ta replication factor 1 speed up the processing? Are there some way to disa=
ble failure monitoring done by Hadoop?<br>

<br>
Thank you for your time.<span class=3D"HOEnZb"><font color=3D"#888888"><br>
<br>
-Sundeep<br>
</font></span></blockquote></div><br></div>

--e89a8fb1fa62a3c3ae04e5ac6eba--