hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark question <markq2...@gmail.com>
Subject SequenceFile.Sorter performance
Date Sun, 24 Apr 2011 17:02:00 GMT
Hi guys,

    I'm trying to sort a 2.5 GB sequence file in one mapper using its
implemented Sort function, but it's taking long that the map is killed for
not reporting .

I would increase the default time to get reports from the mapper, but I'll
do this only if sorting using SequenceFile.sorter is known to be optimal ...
Any one knows ?
Or other suggested options?

    Thanks,

    Mark

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message