hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Prakash (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-1688) A failing retry'able notification in JobEndNotifier can affect notifications of other jobs.
Date Mon, 10 Oct 2011 15:31:29 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124171#comment-13124171
] 

Ravi Prakash commented on MAPREDUCE-1688:
-----------------------------------------

@Vinod : Can't we set the maximum amount of time an HttpMethod can wait when we create it
in JobEndNotifier.httpNotification() ? Perhaps using the parameters defined in http://hc.apache.org/httpclient-3.x/preference-api.html
?


                
> A failing retry'able notification in JobEndNotifier can affect notifications of other
jobs.
> -------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1688
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1688
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker
>    Affects Versions: 0.20.1
>            Reporter: Vinod Kumar Vavilapalli
>
> The JobTracker puts all the notification commands into a delay-queue.  It has a single
thread that loops through this queue and sends out the notifications.  When it hits failures
with any notification which is configured to be retired via {{job.end.retry.attempts}} and
{{job.end.retry.interval}}, the notification is queued back again. A single notification with
sufficiently large number of configured retries and which consistently fails will affect other
notifications in the queue.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message