hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Seigel <ja...@tynt.com>
Subject Re: why quick sort when spill map output?
Date Mon, 28 Feb 2011 12:36:00 GMT
Sorting out of the map phase is core to how hadoop works.  Are you asking why sort at all?
 or why did someone use quick sort as opposed to _____sort?


On 2011-02-28, at 3:30 AM, elton sky wrote:

> Hello forumers,
> Before spill the data in kvbuffer to local disk in map task, k/v are
> sorted using quick sort. The complexity of quick sort is O(nlogn) and
> worst case is O(n^2).
> Why using quick sort?
> Regards

View raw message