hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Niels Basjes <Ni...@basjes.nl>
Subject Re: AW: How to split a big file in HDFS by size
Date Mon, 20 Jun 2011 14:38:35 GMT
Hi,

On Mon, Jun 20, 2011 at 16:13, Mapred Learn <mapred.learn@gmail.com> wrote:
> But this file is a gzipped text file. In this case, it will only go to 1 mapper than
the case if it was
> split into 60 1 GB files which will make map-red job finish earlier than one 60 GB file
as it will
> Hv 60 mappers running in parallel. Isn't it so ?

Yes, that is very true.

-- 
Best regards / Met vriendelijke groeten,

Niels Basjes

Mime
View raw message