hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karim Awara <karim.aw...@kaust.edu.sa>
Subject HDFS splitting file to 64MB blocks
Date Tue, 24 Sep 2013 08:33:19 GMT

I want to know when I upload a file from the local disk to hdfs in a
distributed environment (local cluster),  the file gets split into blocks
of 64MB each. assuming the file resides on the namenode, who splits the
file (namenode)?  what if the file resides on a datanode, does the scenario

I want to change the way the file is split to 64MB chunks; I want to
use my own 'split partitioner' .. which class handles the split file into
64MB chunks in the hdfs?

Best Regards,
Karim Ahmed Awara


This message and its contents, including attachments are intended solely 
for the original recipient. If you are not the intended recipient or have 
received this message in error, please notify me immediately and delete 
this message from your computer system. Any unauthorized use or 
distribution is prohibited. Please consider the environment before printing 
this email.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message