hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Prakash (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3484) Job end notification method should be called before stop() in handle(JobFinishEvent)
Date Tue, 29 Nov 2011 22:09:39 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159574#comment-13159574
] 

Ravi Prakash commented on MAPREDUCE-3484:
-----------------------------------------

This is the exception we noticed. Although 2 more retries were left, the InterruptedException
caused the notification to not happen. 

{noformat}
2011-11-29 20:13:09,259 WARN [AsyncDispatcher event handler] org.mortbay.log: Job end notification
to <someURL> failed
java.net.UnknownServiceException: no content-type
        at java.net.URLConnection.getContentHandler(URLConnection.java:1192)
        at java.net.URLConnection.getContent(URLConnection.java:689)
        at org.apache.hadoop.mapreduce.v2.app.JobEndNotifier.notifyURLOnce(JobEndNotifier.java:95)
        at org.apache.hadoop.mapreduce.v2.app.JobEndNotifier.notify(JobEndNotifier.java:139)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:397)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:370)
        at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
        at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
        at java.lang.Thread.run(Thread.java:619)
2011-11-29 20:13:09,259 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.MRAppMaster:
Job end notification interrupted for jobID : <some jobID>
java.lang.InterruptedException: sleep interrupted
        at java.lang.Thread.sleep(Native Method)
        at org.apache.hadoop.mapreduce.v2.app.JobEndNotifier.notify(JobEndNotifier.java:141)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:397)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:370)
        at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
        at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
        at java.lang.Thread.run(Thread.java:619)
{noformat}

Does anyone know if I'm seeing the InterruptedException because the NM is trying to reclaim
resources? i.e. did it try killing the AM process?

                
> Job end notification method should be called before stop() in handle(JobFinishEvent)
> ------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3484
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3484
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mr-am, mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ravi Prakash
>            Assignee: Ravi Prakash
>
> We noticed JobEndNotifier was getting an InterruptedException before completing all its
retries.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message