hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3446) The reduce task should not flush the in memory file system before starting the reducer
Date Tue, 09 Sep 2008 23:51:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12629660#action_12629660

Hadoop QA commented on HADOOP-3446:

-1 overall.  Here are the results of testing the latest attachment 
  against trunk revision 693587.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 6 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    -1 core tests.  The patch failed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3222/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3222/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3222/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3222/console

This message is automatically generated.

> The reduce task should not flush the in memory file system before starting the reducer
> --------------------------------------------------------------------------------------
>                 Key: HADOOP-3446
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3446
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Owen O'Malley
>            Assignee: Chris Douglas
>            Priority: Critical
>             Fix For: 0.19.0
>         Attachments: 3446-0.patch, 3446-1.patch, 3446-2.patch, 3446-3.patch, 3446-4.patch,
3446-5.patch, 3446-6.patch, 3446-7.patch
> In the case where the entire reduce inputs fit in ram, we currently force the input to
disk and re-read it before giving it to the reducer. It would be much better if we merged
from the ramfs and any spills to feed the reducer its input.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message