Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E7D18CA2E for ; Sun, 14 Jul 2013 10:44:48 +0000 (UTC) Received: (qmail 27861 invoked by uid 500); 14 Jul 2013 10:44:36 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 27757 invoked by uid 500); 14 Jul 2013 10:44:34 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 27749 invoked by uid 99); 14 Jul 2013 10:44:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Jul 2013 10:44:33 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of varun.uid@gmail.com designates 209.85.214.176 as permitted sender) Received: from [209.85.214.176] (HELO mail-ob0-f176.google.com) (209.85.214.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Jul 2013 10:44:27 +0000 Received: by mail-ob0-f176.google.com with SMTP id v19so12730783obq.7 for ; Sun, 14 Jul 2013 03:44:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=SiDi8Zgj5pVcykKCAMpkL3nbVhO2qiG5AXPBqgCVMgc=; b=x2+V9j0pIEQ50YExG4Wzgrnw5n6Wyw450TAPkqsJsF+I+Q9rc8oENqxP5qmmtRrafz IMAHQKRpqtNkcUqEq7/ZHAo+A0Ilyry2wG6wyNVBE+q4MqX2p0mSEpmKhZGqXitz8wGZ 9OzO6W6pUJqeZRKS5wzkS26xVp/toV+OFfOxioWE7har15uvWMAk03FBceBDnJaH0lNN Ebzlblj55btcfcEoJFAUO3MKiOzZF05ihqrqcMeRxcr3O0Cw3mT5EjYjXYsixFMfsxkq 3lJLtOW1ZK8dbrLZbCkok4M14VYFMT6FHgm01vl41eNq57m2uXwhbEDzD8xe7U8nllYZ mHqw== MIME-Version: 1.0 X-Received: by 10.182.134.229 with SMTP id pn5mr40965759obb.9.1373798647059; Sun, 14 Jul 2013 03:44:07 -0700 (PDT) Received: by 10.60.7.196 with HTTP; Sun, 14 Jul 2013 03:44:06 -0700 (PDT) In-Reply-To: References: <1373647822.97470.YahooMailNeo@web140402.mail.bf1.yahoo.com> Date: Sun, 14 Jul 2013 16:14:06 +0530 Message-ID: Subject: Re: Hadoop property precedence From: varun kumar To: user , shalishvj@yahoo.com Content-Type: multipart/alternative; boundary=001a11c2570e59dc3104e1766c3a X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2570e59dc3104e1766c3a Content-Type: text/plain; charset=ISO-8859-1 What Shumin told is correct,hadoop configurations has been over written through client application. We have faced similar type of issue,Where default replication factor was mentioned 2 in hadoop configuration.But when when ever the client application writes a files,it was having 3 copies in hadoop cluster.Later on checking client application it's default replica factor has 3. On Sun, Jul 14, 2013 at 4:51 AM, Shumin Guo wrote: > I Think the client side configuration will take effect. > > Shumin > On Jul 12, 2013 11:50 AM, "Shalish VJ" wrote: > >> Hi, >> >> >> Suppose block size set in configuration file at client side is 64MB, >> block size set in configuration file at name node side is 128MB and block >> size set in configuration file at datanode side is something else. >> Please advice, If the client is writing a file to hdfs,which property >> would be executed. >> >> Thanks, >> Shalish. >> > -- Regards, Varun Kumar.P --001a11c2570e59dc3104e1766c3a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
What Shumin told is correct,hadoop configurations has been= over written through client application.

We have faced = similar type of issue,Where default replication factor was mentioned 2 in h= adoop configuration.But when when ever the client =A0application writes a f= iles,it was having 3 copies in hadoop cluster.Later on checking client appl= ication it's default replica factor has 3.


On Sun,= Jul 14, 2013 at 4:51 AM, Shumin Guo <gsmsteve@gmail.com> w= rote:

I Think the client side configuration wil= l take effect.

Shumin

On Jul 12, 2013 11:50 AM, "Shalish VJ"= <shalishvj@yah= oo.com> wrote:
Hi,
=A0
=A0
=A0=A0=A0=A0<= /span>Suppose block size set in configuration file at client side is 64MB,<= /div>
block size set in configuration file at name node side is 128MB and block s= ize set in configuration file at=A0datanode side is something else.
Please advice, If=A0the client is writing a file to hdfs,which property = would be executed.
=A0
Thanks,
Shalish.



--
=
Regards,
Varun Kumar.P=
--001a11c2570e59dc3104e1766c3a--