hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3382) Network ACLs can prevent AMs to ping the Job-end notification URL
Date Wed, 09 Nov 2011 03:49:51 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146758#comment-13146758

Vinod Kumar Vavilapalli commented on MAPREDUCE-3382:

Stumbled on this while discussing with [~rohini] on random things in MRV2 ;)

We can one of the couple of things:
 - MR AMs could go through a separate http proxy inside the cluster to which network ACLs
can permit trips to outside world.
 - We could overload the web-proxy that we already have in ResourceManager for this purpose.
Either way we need to fix MR AM to use a http proxy configuration.
> Network ACLs can prevent AMs to ping the Job-end notification URL
> -----------------------------------------------------------------
>                 Key: MAPREDUCE-3382
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3382
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: applicationmaster, mrv2
>    Affects Versions: 0.23.0
>            Reporter: Vinod Kumar Vavilapalli
>             Fix For: 0.23.1
> MAPREDUCE-3028 added support for job-end notification from MR AMs after the job finishes.
Network ACLs can have an implication on this one - outgoing connections from the compute nodes
may be restricted in some settings and so job-end notification( that can originate from the
AMs which may run on random nodes in the cluster) may have issues.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message