hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shahab Yunus <shahab.yu...@gmail.com>
Subject Re: Block size
Date Fri, 03 Jan 2014 16:45:49 GMT
Yes it can. It is a configurable property. The exact name might differ
depending on the version though.


Read the details here:
https://hadoop.apache.org/docs/current2/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml

http://books.google.com/books?id=H3mvcxPeUfwC&pg=PA183&lpg=PA183&dq=change+hadoop+default+block+size&source=bl&ots=pXxPwd2Hv8&sig=xbcUaJ10zOkLqOPw4u35ZTRPCVc&hl=en&sa=X&ei=gujGUs-eK4ulsASMi4GIDw&ved=0CFYQ6AEwAw#v=onepage&q=change%20hadoop%20default%20block%20size&f=false

You can do it programmatically as well.
http://stackoverflow.com/questions/2669800/changing-the-block-size-of-a-dfs-file-in-hadoop

Changing for an existing file:
http://stackoverflow.com/questions/7320625/how-to-dynamic-change-existing-files-block-size-in-hadoop

Regards,
Shahab


On Fri, Jan 3, 2014 at 11:37 AM, Kurt Moesky <kurtmoesky@gmail.com> wrote:

> I see the default block size for HDFS is 64 MB, is this a value that can
> be changed easily?
>

Mime
View raw message