hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-4061) RM only has 1 AM launcher thread
Date Mon, 26 Mar 2012 18:58:36 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Thomas Graves updated MAPREDUCE-4061:
-------------------------------------

    Attachment: MAPREDUCE-4061.patch

increased the number of threads in AM launch to 10 and then also saw the same bug in the MR
app master taskCleaner, so increased that to 5.  
                
> RM only has 1 AM launcher thread
> --------------------------------
>
>                 Key: MAPREDUCE-4061
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4061
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.2
>            Reporter: Thomas Graves
>            Assignee: Thomas Graves
>            Priority: Critical
>         Attachments: MAPREDUCE-4061.patch
>
>
> The application master launcher has a thread pool that is configured with core size 1,
maximum 10.  The thread pool will not create over
> the core size thread unless the queue it is using is full. We are using an unbounded
queue, so the thread pool will only ever create 1 thread.  We need to have more then 1 AM
launch thread.
> If that thread becomes hung for some reason, the RM can no longer launch any application
masters.  We have seen an instance of this when a NM become unresponsive - something bad happened
to host, not sure what yet.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message