hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: what to do with the remaind space in the last block
Date Thu, 05 May 2011 08:47:26 GMT
Hello xu,

On Thu, May 5, 2011 at 1:19 PM, cheng xu <xcheng.xu@gmail.com> wrote:
> as we know. the last block of file may be less then 64MB(as default
> configged), then what will hdfs do with the remained space in the block??
> left for other files or just left unused??

Since no form of pre-allocation is performed while 'creating' blocks,
it only consumes space as is required of the data being streamed. A 64
MB block size is a logical term in HDFS to signify the 'split size' of
incoming data.

Harsh J

View raw message