Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 635146EA7 for ; Thu, 19 May 2011 00:07:39 +0000 (UTC) Received: (qmail 58880 invoked by uid 500); 19 May 2011 00:07:38 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 58837 invoked by uid 500); 19 May 2011 00:07:38 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 58827 invoked by uid 99); 19 May 2011 00:07:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 May 2011 00:07:38 +0000 X-ASF-Spam-Status: No, hits=2.9 required=5.0 tests=FREEMAIL_FROM,FS_REPLICA,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mail4steve@gmail.com designates 209.85.220.176 as permitted sender) Received: from [209.85.220.176] (HELO mail-vx0-f176.google.com) (209.85.220.176) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 May 2011 00:07:31 +0000 Received: by vxa37 with SMTP id 37so2474224vxa.35 for ; Wed, 18 May 2011 17:07:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:references:in-reply-to:mime-version :content-transfer-encoding:content-type:message-id:cc:x-mailer:from :subject:date:to; bh=GTMUEsBFTqA7iobkoa2PbvkuyucY8R92jYfWS3skgfE=; b=NS1JH+IW2JXyFNsUxqQtXXpR45+qVtMEjiUgEVi+oYSAm0oh+bF3UlGmQctD4Qj9nJ 2oGzW0VggfUGzYchtI5qfAcCeXfFgNszGLXpsZSb+vrb3Rfv1AcTfw+zY0Z2gMYGptUw 89UFAB4kXtjqy/mbHYy9GNGZf/aFcpNK9jJiA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=references:in-reply-to:mime-version:content-transfer-encoding :content-type:message-id:cc:x-mailer:from:subject:date:to; b=NjiqCfpm2uAEvCtasHO3BtgaurDsgZ/R4kzUpN63hGtSaqCRGGXUk/xtkA6HsLGlud 3Xwqo/w0bbhudoFEaBabUcNdhsXkiiW45DpKjGzouzHmNzEH7CR8xzJdiu0YlDkgdI67 vVxF8ivd79kZ9wnXbEIQnvO1glQ/DfEWNaroQ= Received: by 10.52.98.104 with SMTP id eh8mr3761897vdb.289.1305763630347; Wed, 18 May 2011 17:07:10 -0700 (PDT) Received: from [10.0.1.11] (c-69-251-245-124.hsd1.md.comcast.net [69.251.245.124]) by mx.google.com with ESMTPS id dq2sm467815vdc.43.2011.05.18.17.07.08 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 18 May 2011 17:07:09 -0700 (PDT) References: In-Reply-To: Mime-Version: 1.0 (iPad Mail 8J2) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Message-Id: Cc: "hdfs-user@hadoop.apache.org" X-Mailer: iPad Mail (8J2) From: Steve Cohen Subject: Re: replicating existing blocks? Date: Wed, 18 May 2011 20:07:21 -0400 To: "hdfs-user@hadoop.apache.org" X-Virus-Checked: Checked by ClamAV on apache.org Thanks for the answer. Earlier, I asked about why I get occasional not repli= cated yet errors. Now, I had dfs.replication set to one. What replication co= uld it have been doing? Did the error messages actually mean that the file c= ouldn't get created in the cluster? Thanks, Steve Cohen On May 18, 2011, at 6:39 PM, Todd Lipcon wrote: > Tried to send this, but apparently SpamAssassin finds emails about > "replicas" to be spammy. This time with less rich text :) >=20 > On Wed, May 18, 2011 at 3:35 PM, Todd Lipcon wrote: >>=20 >> Hi Steve, >> Running setrep will indeed change those files. Changing "dfs.replication"= just changes the default replication value for files created in the future.= Replication level is a file-specific property. >> Thanks >> -Todd >>=20 >> On Wed, May 18, 2011 at 3:32 PM, Steve Cohen wrote= : >>>=20 >>> Say I add a datanode to a pseudo cluster and I want to change the >>> replication factor to 2. I see that I can either run hadoop fs -setrep >>> or change the hdfs-site.xml value for dfs.replication. But do either >>> of these cause the existing blocks to replicate? >>>=20 >>> Thanks, >>> Steve Cohen >>=20 >>=20 >>=20 >> -- >> Todd Lipcon >> Software Engineer, Cloudera >=20 >=20 >=20 > -- > Todd Lipcon > Software Engineer, Cloudera