hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: Are lines broken in dfs and/or in InputSplit
Date Thu, 07 Aug 2008 21:08:50 GMT
Kevin wrote:
> Yes, I have looked at the block files and it matches what you said. I
> am just wondering if there is some property or flag that would turn
> this feature on, if it exists.

No.  If you required this then you'd need to pad your data, but I'm not 
sure why you'd ever require it.  Running off the end of a block in 
mapreduce makes for a small amount of non-local i/o, but it's generally 
insignificant.

Doug

Mime
View raw message