Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3B780F764 for ; Sun, 31 Mar 2013 16:31:23 +0000 (UTC) Received: (qmail 15484 invoked by uid 500); 31 Mar 2013 16:31:18 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 15167 invoked by uid 500); 31 Mar 2013 16:31:17 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 15138 invoked by uid 99); 31 Mar 2013 16:31:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 31 Mar 2013 16:31:16 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jens.scheidtmann@gmail.com designates 209.85.214.171 as permitted sender) Received: from [209.85.214.171] (HELO mail-ob0-f171.google.com) (209.85.214.171) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 31 Mar 2013 16:31:09 +0000 Received: by mail-ob0-f171.google.com with SMTP id x4so1383680obh.30 for ; Sun, 31 Mar 2013 09:30:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=L+njRXeO6i1+QrERkYg5YsphU0rsfkw2ZJCFu5RBnok=; b=Zk6F4V7j0Gyz2USos5PlMumvDHTsqhzO1XP9y5qtgi3DKDa92pu3zRmpLgbSj8eyqF 3vmCkxOs8XHBnHfTK1xLR8cnrXbOC3xa0Rpur+uHB9Qt/d8LzsLWCHUSAk+RF7ON4Ett +gQztgif5uwWDysDCQfROBrzNQlFiTxtjrK5aUlxrsoEWPXm/Ct/LHQtmQ3Dur7Iet9M 4v0oXCKpGlkHfu3P5bFnVvEiKpqORRMsCS4H15zjXaWlPIkT6IaJa1QeYnMfp5rq1gfm WkwTlYz9qt97IAmjyXig620PYZGteQesf3SFyck6o3KwAsxyWfjTCZ3nWPkhZWP5pqlB nivw== MIME-Version: 1.0 X-Received: by 10.60.62.70 with SMTP id w6mr3227432oer.38.1364747449112; Sun, 31 Mar 2013 09:30:49 -0700 (PDT) Received: by 10.60.15.196 with HTTP; Sun, 31 Mar 2013 09:30:48 -0700 (PDT) In-Reply-To: <1364719534.91394.YahooMailNeo@web194703.mail.sg3.yahoo.com> References: <1364377874.13753.YahooMailNeo@web194703.mail.sg3.yahoo.com> <1364577771.12724.YahooMailNeo@web194704.mail.sg3.yahoo.com> <1364719534.91394.YahooMailNeo@web194703.mail.sg3.yahoo.com> Date: Sun, 31 Mar 2013 18:30:48 +0200 Message-ID: Subject: Re: Who splits the file into blocks From: Jens Scheidtmann To: user@hadoop.apache.org, Sai Sai Content-Type: multipart/alternative; boundary=089e01294f30e9e84804d93b0631 X-Virus-Checked: Checked by ClamAV on apache.org --089e01294f30e9e84804d93b0631 Content-Type: text/plain; charset=ISO-8859-1 Dear Sai Sai, "Hadoop, the definitive guide" says regarding default replica placement: - first replica is placed on the same node as the client (lowest bandwidth penalty). - second replica is placed off-rack, at a random node of the other rack (avoiding busy racks). - third replicate is placed on random node on rack where second replica is stored. - other replicas are placed on random nodes of the cluster (avoiding busy racks). If client is not on the cluster, first replica is placed on a random node (avoiding busy racks). Best regards, Jens --089e01294f30e9e84804d93b0631 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Dear Sai Sai,

&= quot;Hadoop, the definitive guide" says regarding default replica plac= ement:

- first replica is placed on the same node as the clien= t (lowest bandwidth penalty).
- second replica is placed off-rack, at a random node of the other ra= ck (avoiding busy racks).
- third replicate is placed on random n= ode on rack where second replica is stored.
- other replicas are placed = on random nodes of the cluster (avoiding busy racks).

If client is not on the cluster, first replica is placed on = a random node (avoiding busy racks).

Best regards,<= br>

Jens
--089e01294f30e9e84804d93b0631--