hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Gummadi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2957) The TT should not re-init if it has no good local dirs
Date Thu, 15 Sep 2011 06:04:09 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105132#comment-13105132
] 

Ravi Gummadi commented on MAPREDUCE-2957:
-----------------------------------------

+1 to avoid calling TaskTracker.initialize() if there are no good local dirs.

 Even with this patch, i.e. though State.DENIED is returned by offerService() when DiskCheckerException
is seen, initialize() is getting called once more and is getting DiskCheckerException from
TT.initialize() -> DiskChecker.checkLocalDirs(). This behavior is similar to what was happening
without this patch. This needs to be improved somehow and we need to avoid the call to TT.initialize()
in this case.

> The TT should not re-init if it has no good local dirs
> ------------------------------------------------------
>
>                 Key: MAPREDUCE-2957
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2957
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: tasktracker
>    Affects Versions: 0.20.204.0
>            Reporter: Eli Collins
>            Assignee: Eli Collins
>             Fix For: 0.20.205.0
>
>         Attachments: mapreduce-2957.patch
>
>
> The TT will currently try to re-init itself on disk failure even if it has no good local
dirs. It should shutdown instead.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message