hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4302) TestReduceFetch fails intermittently
Date Mon, 29 Sep 2008 21:44:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12635549#action_12635549
] 

Chris Douglas commented on HADOOP-4302:
---------------------------------------

The test is nondeterministic; though it sets mapred.inmem.merge.threshold to 2, the third
may be fetched, closed, and included in the in-memory merge. In this case, all the outputs
will be merged to disk. The test should probably set mapred.reduce.parallel.copies to 1 to
avoid the race, here. Off-by-n misses on mapred.inmem.merge.threshold aren't a real bug, not
even for the final outputs; it's a heuristic, not a contract.

> TestReduceFetch fails intermittently
> ------------------------------------
>
>                 Key: HADOOP-4302
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4302
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Devaraj Das
>            Assignee: Chris Douglas
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: 0J5g5b71.html.part
>
>
> I see TestReduceFetch failing once in a while. Here is one such failure 
> http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3350/testReport/org.apache.hadoop.mapred/TestReduceFetch/testReduceFromPartialMem/
> Marking this as a blocker until we get to the root cause.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message