Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D0A38106E8 for ; Mon, 26 May 2014 20:10:45 +0000 (UTC) Received: (qmail 32467 invoked by uid 500); 26 May 2014 20:10:39 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 32336 invoked by uid 500); 26 May 2014 20:10:39 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 32329 invoked by uid 99); 26 May 2014 20:10:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 May 2014 20:10:39 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sindhuht@gmail.com designates 74.125.82.47 as permitted sender) Received: from [74.125.82.47] (HELO mail-wg0-f47.google.com) (74.125.82.47) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 26 May 2014 20:10:34 +0000 Received: by mail-wg0-f47.google.com with SMTP id x12so8287620wgg.18 for ; Mon, 26 May 2014 13:10:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version; bh=ch+K2KFru14X8qbSrovFQRbzYyICCstnI4b0lCINMGg=; b=cKlcNDRo11ytsQbIwDiT6d5kx4+x71QdUGNV8HyTSXbzUIqbaSzSzJpaDhyh1+N8Lb CK38rQcU9+UMHf1mI8o7kj2JbQC8cK7dozCWCcUoHvJCee16fMyLlodahTeaolVTn/HX X5YXHBrDupjXIkkUK3CUUwvC3liXIgHvDW0ZhDOzHcZqSDUgUpSLr4cS6V/G8k9hbSDM JBBAQDEKjJMEkHRNQS7utuAT5EzUxe1BtQX4mgJjNp31UzFRFaKEGPUqklSCaisjtcd1 0AnyNgjPG5sbnVqVMFw4gOiXKuopa2ID+0XkOl9JEoegkN3qZx/eDYKJrjZL+LujQpUW qjCw== X-Received: by 10.194.189.116 with SMTP id gh20mr33605475wjc.41.1401135011019; Mon, 26 May 2014 13:10:11 -0700 (PDT) Received: from [192.168.1.6] (g225245145.adsl.alicedsl.de. [92.225.245.145]) by mx.google.com with ESMTPSA id q2sm2426774wix.5.2014.05.26.13.10.09 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 26 May 2014 13:10:10 -0700 (PDT) From: Sindhu Hosamane Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Subject: Re: How to make sure data blocks are shared between 2 datanodes Message-Id: Date: Mon, 26 May 2014 22:10:08 +0200 To: user@hadoop.apache.org Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.2\)) X-Mailer: Apple Mail (2.1878.2) X-Virus-Checked: Checked by ClamAV on apache.org ok .thanks a lot that information .=20 As i said i am running 2 datanodes on same machine . so my haddop home = has 2 conf folders . conf and conf2 and in turn 2 hdfs-site.xml in both conf folders . I guess dfs.replication value in hdfs-site.xml of conf folder should be = 3 . What should i have it in conf2 ? should it be 1 there ? sorry if question sounds stupid . But i am unfamiliar with these kind of = settings ( 2 datanodes on same machine ..so having 2 conf ) If data is split across multiple datanodes , then processing capacity = would be improved - ( thats what i guess ) since my file is only 240 KB = , it occupies only one block . It cannot use second block and remain in = another datanode .=20 So now , does it make sense to reduce the block size so that blocks are = split between 2 datanodes =97if i want to take very much advantage of = multiple datanodes . Any advices ? Your help would be appreciated . Best Regards, Sindhu