hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Segel, Mike" <mse...@navteq.com>
Subject RE: how to split data
Date Sat, 17 Apr 2010 22:43:37 GMT

Its really the second one. Files are split in to blocks depending on a configuration parameter.
By default its 64MB. Using your example, the splits are 64,64,1 however the 1 MB is within
an allocated block of size 64MB. 


-----Original Message-----
From: lee.sungeun@wipro.com [mailto:lee.sungeun@wipro.com] 
Sent: Tuesday, April 13, 2010 11:35 PM
To: general@hadoop.apache.org
Subject: how to split data

i am studying about hadoop and sending a mail to know how to split data. if the block size
is 64MB and i am supposed to hadle 129MB. How will it split? (64,64,1) or (64,64,64) . i think
first one is right. but i want to get informaiton more detail.
so if possible, just let me know it.
sungeun lee

Please do not print this email unless it is absolutely necessary. 

The information contained in this electronic message and any attachments to this message are
intended for the exclusive use of the addressee(s) and may contain proprietary, confidential
or privileged information. If you are not the intended recipient, you should not disseminate,
distribute or copy this e-mail. Please notify the sender immediately and destroy all copies
of this message and any attachments. 

WARNING: Computer viruses can be transmitted via email. The recipient should check this email
and any attachments for the presence of viruses. The company accepts no liability for any
damage caused by any virus transmitted by this email. 


The information contained in this communication may be CONFIDENTIAL and is intended only for
the use of the recipient(s) named above.  If you are not the intended recipient, you are hereby
notified that any dissemination, distribution, or copying of this communication, or any of
its contents, is strictly prohibited.  If you have received this communication in error, please
notify the sender and delete/destroy the original message and any copy of it from your computer
or paper files.

View raw message