Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 68CF045DC for ; Mon, 6 Jun 2011 20:09:01 +0000 (UTC) Received: (qmail 54401 invoked by uid 500); 6 Jun 2011 20:09:00 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 54350 invoked by uid 500); 6 Jun 2011 20:09:00 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 54342 invoked by uid 99); 6 Jun 2011 20:09:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Jun 2011 20:09:00 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,RFC_ABUSE_POST,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [98.139.91.72] (HELO nm2.bullet.mail.sp2.yahoo.com) (98.139.91.72) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 06 Jun 2011 20:08:52 +0000 Received: from [98.139.91.66] by nm2.bullet.mail.sp2.yahoo.com with NNFMP; 06 Jun 2011 20:08:31 -0000 Received: from [98.139.91.57] by tm6.bullet.mail.sp2.yahoo.com with NNFMP; 06 Jun 2011 20:08:31 -0000 Received: from [127.0.0.1] by omp1057.mail.sp2.yahoo.com with NNFMP; 06 Jun 2011 20:08:31 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 216112.50059.bm@omp1057.mail.sp2.yahoo.com Received: (qmail 64569 invoked by uid 60001); 6 Jun 2011 20:08:30 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1307390910; bh=lKTNL+y1oztGLr5kKsF7nypuFB+LQxePCXcQ4sdMrzo=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=ly1SJgYiRRc8WudLpj/hT8WvknZxayHEq0i3t1mdC/P9WOBeS7cEPOvN6dU6/LozYOEuD6OP0L3rr+2MOHFNfK8HAbHfzMMKUqmMP+LZhqE7bfuXMHBaLztTnL7qODPYyZDJ9n4Y1m9/Pk5IW+bTMsXEIUzK6jC9xrk47cXuxmc= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=qJD3MRqW4C/fPSgL7FsqypiCGaXir631YDsqVY9JXSvu592UO9f4fpGNW380kQEREODCi7yuAbT8NZiSiyVDrcMQkJkaXK88sDKLP9zdcYRmxMwdQpIlOe4dcpKZ2sMjOw0tAQ3gtrEV8YbrDDzfSfhIEWSQ1zxrUA6M5NjwsJs=; Message-ID: <599117.61676.qm@web110502.mail.gq1.yahoo.com> X-YMail-OSG: waG8dD4VM1mXoiWYYkkprCwui01PHw94IOHbvj.Bm0bn.Xg gwT8Lc8CeFJ9B.nA9vGyG5wwoAlKreFh1uG.sF1kCVdS6ltkzlg6SlVw5Dzb geoCBnBNkwSP7rUBGWPwAJ1nn1Q_JsAYBmZQ2FTvsXxzOeptmywditXZBI1g .Pyd3EMSGAjrQt9FZBEusHgf9S10HxdrJSipurweRlbSnkqtTtmVzLIHRwUc 9ws3owh0mUCyHLpQlpvrG03ukL0otFj6vULxnfSXqzRlbmPU.m5.8r1cPPNG Z4wprWIQyU1MuwiyOP1jwmOhgLbTK5XclcuuvdjwXjsropbkXO_Uvyw4_INq MVr7yWzXy7iGdpRnsSX1SpKDPOe1X16cUKmINcUD9t2HoL8xu8hd07TUOxS8 gTMZpeT.8iU1bX2hiFbEtKZxEI_bovKYsnec1tuSncUqT9mklKHhBViwWqdY DgcgcOPzoJee3vgh.NQabBkVvmjLDCkxR3Lr1y0_Dw0mLLrZncmM8wgVJqt2 4SMJ_6bArhd3AxAvtE0Cd2qVrEUYnHALiuR28XkGuU0NoximaQSOnn8xT8UG Iy305JR527MGEDUSuUk52 Received: from [173.164.150.189] by web110502.mail.gq1.yahoo.com via HTTP; Mon, 06 Jun 2011 13:08:30 PDT X-Mailer: YahooMailWebService/0.8.111.304355 References: Date: Mon, 6 Jun 2011 13:08:30 -0700 (PDT) From: Ayon Sinha Reply-To: Ayon Sinha Subject: Re: Changing dfs.block.size To: "hdfs-user@hadoop.apache.org" In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="0-1332599087-1307390910=:61676" X-Virus-Checked: Checked by ClamAV on apache.org --0-1332599087-1307390910=:61676 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable =A0Do newly created files get the default blocksize and old files remain th= e same? Yes=0A=0AIs there a way to change the blocksize of existing files? = I have done this using copy-out and copy back in script. Couldn't find a sh= ort-cut analogous to setrep.=0A=0A=A0=0A-Ayon=0ASee My Photos on Flickr=0AA= lso check out my Blog for answers to commonly asked questions.=0A=0A=0A=0A_= _______________________________=0AFrom: J. Ryan Earl =0AT= o: hdfs-user@hadoop.apache.org=0ASent: Monday, June 6, 2011 12:09 PM=0ASubj= ect: Changing dfs.block.size=0A=0A=0AHello,=0A=0ASo I have a question about= changing dfs.block.size in $HADOOP_HOME/conf/hdfs-site.xml. =A0I understan= d that when files are created, blocksizes can be modified from default. =A0= What happens if you modify the blocksize of an existing HDFS site? =A0Do ne= wly created files get the default blocksize and old files remain the same? = =A0Is there a way to change the blocksize of existing files; I'm assuming y= ou could write MapReduce job to do it, but any build in facilities?=0A=0ATh= anks,=0A-JR --0-1332599087-1307390910=:61676 Content-Type: text/html; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable
 Do newly created files= get the default blocksize and old files remain the same? Yes
Is there a way to change the blocksize of existing files? I h= ave done this using copy-out and copy back in script. Couldn't find a short= -cut analogous to setrep.
 

From:= J. Ryan Earl <oss@jryanearl.us>
To: hdfs-user@hadoop.apache.org
Sent: Monday, June 6, 2011 12:09 PM
= Subject: Changing dfs.bloc= k.size

=0A
Hello,

= So I have a question about changing dfs.block.size in $HADOOP_HOME/conf/hdf= s-site.xml.  I understand that when files are created, blocksizes can = be modified from default.  What happens if you modify the blocksize of= an existing HDFS site?  Do newly created files get the default blocks= ize and old files remain the same?  Is there a way to change the block= size of existing files; I'm assuming you could write MapReduce job to do it= , but any build in facilities?
=0A

Thanks,
-JR


=0A


--0-1332599087-1307390910=:61676--