hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-287) Speed up SequenceFile sort with memory reduction
Date Thu, 14 Feb 2008 19:05:13 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Douglas updated HADOOP-287:

    Status: Open  (was: Patch Available)

The current patch effected no measurable improvements for any benchmarks we ran, so I'm pulling
it back for now.

> Speed up SequenceFile sort with memory reduction
> ------------------------------------------------
>                 Key: HADOOP-287
>                 URL: https://issues.apache.org/jira/browse/HADOOP-287
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: io
>    Affects Versions: 0.17.0
>            Reporter: Benjamin Reed
>            Assignee: Doug Cutting
>         Attachments: 287-1.patch, 287-2.patch, 287-2.patch, s.patch, zoom-sort.patch,
> I replaced the merge sort with a quick sort and it yielded approx 30% improvement in
sort time. It also reduced the memory requirement for sorting because the sort is done in

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message