hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: almost sorted map output
Date Mon, 31 May 2010 01:17:26 GMT
Check out https://issues.apache.org/jira/browse/HADOOP-3442
and https://issues.apache.org/jira/browse/HADOOP-3308


On Fri, May 28, 2010 at 10:58 PM, juber patel <juberpatel@gmail.com> wrote:

> Hello,
>
> Can Hadoop take advantage of the fact that the output of each map task
> is almost sorted?
>
> On a related note, Does Hadoop's Quicksort implementation give worst
> case performance on almost sorted data? Should I use Heapsort in its
> place?
>
>
> thanks,
>
> Juber
>

Mime
View raw message