hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5481) Uber job reducers hang waiting to shuffle map outputs
Date Wed, 13 Nov 2013 19:05:20 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821683#comment-13821683

Alejandro Abdelnur commented on MAPREDUCE-5481:

LTGM, just a couple of questions/comments:

* LocalContainerLauncher.java (line:352 with patch), do we need to do something about it:
{{ //relocalize();  // needed only if more than one reducer supported (is MAPREDUCE-434 fixed
* LocalContainerLauncher.java, the introduced {{localMapFiles Map}},  from a cursory look
it does not seem to be accessed from multiple threads, if so it is fine. Else we need to use
a sync/concurrent map.

> Uber job reducers hang waiting to shuffle map outputs
> -----------------------------------------------------
>                 Key: MAPREDUCE-5481
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5481
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 3.0.0
>            Reporter: Jason Lowe
>            Assignee: Xuan Gong
>            Priority: Blocker
>         Attachments: MAPREDUCE-5481.patch, MAPREDUCE-5481.patch, syslog
> TestUberAM has been timing out on trunk for some time now and surefire then fails the
build.  I'm not able to reproduce it locally, but the Jenkins builds have been seeing it fairly
consistently.  See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1529/console

This message was sent by Atlassian JIRA

View raw message