hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-287) Speed up SequenceFile sort with memory reduction
Date Fri, 01 Feb 2008 00:51:08 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Douglas updated HADOOP-287:

    Status: Open  (was: Patch Available)

Ah, I see. Thanks for the direction. As part of adding QuickSort, would it be worthwhile to
explicitly deprecate some of the dead code in SequenceFile? Is anyone aware of other projects
that might be using it?

> Speed up SequenceFile sort with memory reduction
> ------------------------------------------------
>                 Key: HADOOP-287
>                 URL: https://issues.apache.org/jira/browse/HADOOP-287
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.17.0
>            Reporter: Benjamin Reed
>            Assignee: Doug Cutting
>         Attachments: 287-0.patch, 287-1.patch, s.patch, zoom-sort.patch, zoom-sort.patch
> I replaced the merge sort with a quick sort and it yielded approx 30% improvement in
sort time. It also reduced the memory requirement for sorting because the sort is done in

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message