Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B04DA10E6A for ; Sat, 13 Jul 2013 09:50:07 +0000 (UTC) Received: (qmail 88113 invoked by uid 500); 13 Jul 2013 09:50:01 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 88005 invoked by uid 500); 13 Jul 2013 09:50:00 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 87998 invoked by uid 99); 13 Jul 2013 09:50:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Jul 2013 09:50:00 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of azuryyyu@gmail.com designates 209.85.212.42 as permitted sender) Received: from [209.85.212.42] (HELO mail-vb0-f42.google.com) (209.85.212.42) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Jul 2013 09:49:55 +0000 Received: by mail-vb0-f42.google.com with SMTP id i3so2160707vbh.1 for ; Sat, 13 Jul 2013 02:49:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=TWhg34DNddQBJQ07HHKlpsRn0v/oRWxupw3lpI4yWRs=; b=TYqDNYSBgMSk3QE+N+rXLS7SurBVhYP2md88mq9ZOv7crn6ALy6RdSpZ/wq4U62Mg1 jWl7Ol6BYOGBummPblEhqpxcACTBHQPSUl4gd88XhS5EKvC/0nShI7sKd4Wh3aPi9oUP HQwfqzaAqUj9kUdTLgesioGjNqlbv4udg1u19SmXRfgr5gXfPgbmGI75OpbL2mG5/NU2 mIw3j1s6Msj4hbP5UwkziyMpStwEpyqDDMBCnt3wknFN3VfaTwWWgGycp48AIofZQpoT saBmqGJSdZkGkfmvNI0GtZmuxArvUbRJmZBvWHXUuR3fO2qSNjFbqd6Cag7MIQXT78I4 F1xw== MIME-Version: 1.0 X-Received: by 10.52.245.3 with SMTP id xk3mr22242704vdc.57.1373708973799; Sat, 13 Jul 2013 02:49:33 -0700 (PDT) Received: by 10.220.15.6 with HTTP; Sat, 13 Jul 2013 02:49:33 -0700 (PDT) Received: by 10.220.15.6 with HTTP; Sat, 13 Jul 2013 02:49:33 -0700 (PDT) In-Reply-To: References: <1373647822.97470.YahooMailNeo@web140402.mail.bf1.yahoo.com> Date: Sat, 13 Jul 2013 17:49:33 +0800 Message-ID: Subject: Re: Hadoop property precedence From: Azuryy Yu To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c2575a68804004e1618ba5 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2575a68804004e1618ba5 Content-Type: text/plain; charset=ISO-8859-1 the conf that client running on will take effect. On Jul 13, 2013 4:42 PM, "Kiran Dangeti" wrote: > Shalish, > > The default block size is 64MB which is good at the client end. Make sure > the same at your end also in conf. You can increase the size of each block > to 128MB or greater than that only thing you can see the processing will be > fast but at end there may be chances of losing data. > > Thanks, > Kiran > > > On Fri, Jul 12, 2013 at 10:20 PM, Shalish VJ wrote: > >> Hi, >> >> >> Suppose block size set in configuration file at client side is 64MB, >> block size set in configuration file at name node side is 128MB and block >> size set in configuration file at datanode side is something else. >> Please advice, If the client is writing a file to hdfs,which property >> would be executed. >> >> Thanks, >> Shalish. >> > > --001a11c2575a68804004e1618ba5 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

the conf that client running on will take effect.

On Jul 13, 2013 4:42 PM, "Kiran Dangeti&quo= t; <kirandkumar2013@gmail.c= om> wrote:
Shalish,
=A0
The default block si= ze is 64MB which is good at the client end. Make sure the same at your end = also in conf. You can increase the size of each block to 128MB or greater t= han that only thing=A0you can see the processing will be fast but at end th= ere may be=A0 chances of losing data.
=A0
Thanks,
Kiran


On Fri, Jul 12, 2013 at 10:20 PM, = Shalish VJ <shalishvj@yahoo.com> wrote:
Hi,
=A0
= =A0
=A0=A0=A0=A0Suppose block size set in configuration file = at client side is 64MB,
block size set in configuration file at n= ame node side is 128MB and block size set in configuration file at=A0datano= de side is something else.
Please advice, If=A0the client is writing a file to hdfs,which propert= y would be executed.
=A0
Thanks,
Shalish.

--001a11c2575a68804004e1618ba5--