hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3226) Run combiner when merging spills from map output
Date Tue, 29 Apr 2008 20:58:55 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12593112#action_12593112

Owen O'Malley commented on HADOOP-3226:

I think we should get rid of the spill versus merge combiner input/output record counters.
I think it would just confuse users over the distinction between them.

> Run combiner when merging spills from map output
> ------------------------------------------------
>                 Key: HADOOP-3226
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3226
>             Project: Hadoop Core
>          Issue Type: Improvement
>            Reporter: Chris Douglas
>            Assignee: Chris Douglas
>             Fix For: 0.18.0
>         Attachments: 3226-0.patch, 3226-1.patch, 3226-2.patch
> When merging spills from the map, running the combiner should further diminish the volume
of data we send to the reduce.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message