hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer ...@apache.org>
Subject Re: set reduced block size for a specific file
Date Sat, 27 Aug 2011 22:41:53 GMT

On Aug 27, 2011, at 12:42 PM, Ted Dunning wrote:

> There is no way to do this for standard Apache Hadoop.

	Sure there is.

	You can build a custom conf dir and point it to that.  You *always* have that option for
client settable options as a work around for lack of features/bugs.

	1. Copy $HADOOP_CONF_DIR or $HADOOP_HOME/conf to a dir 
	2. modify the hdfs-site.xml to have your new block size
	3. Run the following:

HADOOP_CONF_DIR=mycustomconf hadoop dfs  -put file dir

	Convenient?  No.  Doable? Definitely.

View raw message