Return-Path: 
 <mapreduce-issues-return-34626-apmail-hadoop-mapreduce-issues-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1AB627ABC
	for <apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org>;
 Tue, 29 Nov 2011 22:10:07 +0000 (UTC)
Received: (qmail 80153 invoked by uid 500); 29 Nov 2011 22:10:06 -0000
Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org
Received: (qmail 80121 invoked by uid 500); 29 Nov 2011 22:10:06 -0000
Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:mapreduce-issues-help@hadoop.apache.org>
List-Unsubscribe: <mailto:mapreduce-issues-unsubscribe@hadoop.apache.org>
List-Post: <mailto:mapreduce-issues@hadoop.apache.org>
List-Id: <mapreduce-issues.hadoop.apache.org>
Reply-To: mapreduce-issues@hadoop.apache.org
Delivered-To: mailing list mapreduce-issues@hadoop.apache.org
Received: (qmail 80113 invoked by uid 99); 29 Nov 2011 22:10:06 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Nov 2011 22:10:06 +0000
X-ASF-Spam-Status: No, hits=-2001.2 required=5.0
	tests=ALL_TRUSTED,RP_MATCHES_RCVD
X-Spam-Check-By: apache.org
Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Nov 2011 22:10:00 +0000
Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116])
	by hel.zones.apache.org (Postfix) with ESMTP id E176EA7685
	for <mapreduce-issues@hadoop.apache.org>;
 Tue, 29 Nov 2011 22:09:39 +0000 (UTC)
Date: Tue, 29 Nov 2011 22:09:39 +0000 (UTC)
From: "Ravi Prakash (Commented) (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Message-ID: 
 <1913282296.23468.1322604579924.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <1410509208.23462.1322604339832.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (MAPREDUCE-3484) Job end notification method
 should be called before stop() in handle(JobFinishEvent)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
X-Virus-Checked: Checked by ClamAV on apache.org


    [ https://issues.apache.org/jira/browse/MAPREDUCE-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159574#comment-13159574 ] 

Ravi Prakash commented on MAPREDUCE-3484:
-----------------------------------------

This is the exception we noticed. Although 2 more retries were left, the InterruptedException caused the notification to not happen. 

{noformat}
2011-11-29 20:13:09,259 WARN [AsyncDispatcher event handler] org.mortbay.log: Job end notification to <someURL> failed
java.net.UnknownServiceException: no content-type
        at java.net.URLConnection.getContentHandler(URLConnection.java:1192)
        at java.net.URLConnection.getContent(URLConnection.java:689)
        at org.apache.hadoop.mapreduce.v2.app.JobEndNotifier.notifyURLOnce(JobEndNotifier.java:95)
        at org.apache.hadoop.mapreduce.v2.app.JobEndNotifier.notify(JobEndNotifier.java:139)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:397)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:370)
        at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
        at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
        at java.lang.Thread.run(Thread.java:619)
2011-11-29 20:13:09,259 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Job end notification interrupted for jobID : <some jobID>
java.lang.InterruptedException: sleep interrupted
        at java.lang.Thread.sleep(Native Method)
        at org.apache.hadoop.mapreduce.v2.app.JobEndNotifier.notify(JobEndNotifier.java:141)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:397)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:370)
        at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:116)
        at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
        at java.lang.Thread.run(Thread.java:619)
{noformat}

Does anyone know if I'm seeing the InterruptedException because the NM is trying to reclaim resources? i.e. did it try killing the AM process?

                
> Job end notification method should be called before stop() in handle(JobFinishEvent)
> ------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3484
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3484
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mr-am, mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ravi Prakash
>            Assignee: Ravi Prakash
>
> We noticed JobEndNotifier was getting an InterruptedException before completing all its retries.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira