Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 40B9910B15 for ; Fri, 3 Jan 2014 16:49:10 +0000 (UTC) Received: (qmail 13263 invoked by uid 500); 3 Jan 2014 16:46:22 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 13139 invoked by uid 500); 3 Jan 2014 16:46:19 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 13128 invoked by uid 99); 3 Jan 2014 16:46:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jan 2014 16:46:16 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of shahab.yunus@gmail.com designates 209.85.214.43 as permitted sender) Received: from [209.85.214.43] (HELO mail-bk0-f43.google.com) (209.85.214.43) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jan 2014 16:46:10 +0000 Received: by mail-bk0-f43.google.com with SMTP id mz12so4947096bkb.16 for ; Fri, 03 Jan 2014 08:45:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=CDTdzcd6toEwZ2EM8EPAm7O2Y/zww/JWjjXzfZMEfNg=; b=KTyAKt7Lu5OB0YSCU2uaWE1muBczh8tI7f81l8VQMR7+IzWCEMzQbpWBZ/HQdsMNgS qushRT19DvQiX6xlEwvXjCqa7oNvsW6lhLTIQKAxFDkVLSkhJ6Eci3IjTLHlK+AwS2Tv v6ONjwCg9/ZK8x44Q+c/pIV3rwIF0W4XLECadsj9w619W3VnMJZKzT88WcrKJUpY6D5A 67AlSyUo5JY6SQ0Ljyl3Qt/bV9143mkp/pERPhE08BuHuaw018BTIlsFPoilJ6AjJsyK d2LoDahoZ7X3pp5aUxJqDZxGKKb6SuV0nsWwiBbvsussFz9w8rYAIMlKu9wopdtDPddA Z0Dw== MIME-Version: 1.0 X-Received: by 10.204.71.5 with SMTP id f5mr28659350bkj.25.1388767549882; Fri, 03 Jan 2014 08:45:49 -0800 (PST) Received: by 10.205.39.199 with HTTP; Fri, 3 Jan 2014 08:45:49 -0800 (PST) In-Reply-To: References: Date: Fri, 3 Jan 2014 11:45:49 -0500 Message-ID: Subject: Re: Block size From: Shahab Yunus To: "user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=047d7bae499a7cb3ea04ef13a496 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bae499a7cb3ea04ef13a496 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Yes it can. It is a configurable property. The exact name might differ depending on the version though. Read the details here: https://hadoop.apache.org/docs/current2/hadoop-project-dist/hadoop-hdfs/hdf= s-default.xml http://books.google.com/books?id=3DH3mvcxPeUfwC&pg=3DPA183&lpg=3DPA183&dq= =3Dchange+hadoop+default+block+size&source=3Dbl&ots=3DpXxPwd2Hv8&sig=3DxbcU= aJ10zOkLqOPw4u35ZTRPCVc&hl=3Den&sa=3DX&ei=3DgujGUs-eK4ulsASMi4GIDw&ved=3D0C= FYQ6AEwAw#v=3Donepage&q=3Dchange%20hadoop%20default%20block%20size&f=3Dfals= e You can do it programmatically as well. http://stackoverflow.com/questions/2669800/changing-the-block-size-of-a-dfs= -file-in-hadoop Changing for an existing file: http://stackoverflow.com/questions/7320625/how-to-dynamic-change-existing-f= iles-block-size-in-hadoop Regards, Shahab On Fri, Jan 3, 2014 at 11:37 AM, Kurt Moesky wrote: > I see the default block size for HDFS is 64 MB, is this a value that can > be changed easily? > --047d7bae499a7cb3ea04ef13a496 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Yes it can. It is a configurable property. The exact name = might differ depending on the version though.


Changing for an existing file:
http://stackoverflow.com/questions/7320= 625/how-to-dynamic-change-existing-files-block-size-in-hadoop

Regards,
Shahab


On Fri, Jan 3, 2014 at 11:37 AM,= Kurt Moesky <kurtmoesky@gmail.com> wrote:
I see the default block siz= e for HDFS is 64 MB, is this a value that can be changed easily?

--047d7bae499a7cb3ea04ef13a496--