hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces
Date Tue, 22 Sep 2015 22:56:05 GMT

    [ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14903614#comment-14903614
] 

Arpit Agarwal commented on YARN-1994:
-------------------------------------

bq. Is it assumed that NM_BIND_HOST is configured to specific IP then NM_ADDRESS is also configured
to the same IP ?
Hi [~Naganarasimha], if NM_BIND_HOST is an IP address other than 0.0.0.0, then NM_ADDRESS
should be set to a host that resolves to that address. Think of NM_BIND_HOST as the server
side setting and NM_ADDRESS as a client side setting. If they are different the client cannot
connect.

I don't think we have tested setting NM_BIND_HOST to anything other than 0.0.0.0. In hindsight
it may have been simpler to expose a boolean setting like NM_BIND_WILDCARD.

bq. May be this a layman question why is it required to bind to all/multiple interfaces ?
Depending on the routing and DNS configs, the client may connect on a different interface
than the one bound by the server. Listening on all interfaces ensures connectivity.

> Expose YARN/MR endpoints on multiple interfaces
> -----------------------------------------------
>
>                 Key: YARN-1994
>                 URL: https://issues.apache.org/jira/browse/YARN-1994
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager, resourcemanager, webapp
>    Affects Versions: 2.4.0
>            Reporter: Arpit Agarwal
>            Assignee: Craig Welch
>             Fix For: 2.6.0
>
>         Attachments: YARN-1994.0.patch, YARN-1994.1.patch, YARN-1994.11.patch, YARN-1994.11.patch,
YARN-1994.12.patch, YARN-1994.13.patch, YARN-1994.14.patch, YARN-1994.15-branch2.patch, YARN-1994.15.patch,
YARN-1994.2.patch, YARN-1994.3.patch, YARN-1994.4.patch, YARN-1994.5.patch, YARN-1994.6.patch,
YARN-1994.7.patch
>
>
> YARN and MapReduce daemons currently do not support specifying a wildcard address for
the server endpoints. This prevents the endpoints from being accessible from all interfaces
on a multihomed machine.
> Note that if we do specify INADDR_ANY for any of the options, it will break clients as
they will attempt to connect to 0.0.0.0. We need a solution that allows specifying a hostname
or IP-address for clients while requesting wildcard bind for the servers.
> (List of endpoints is in a comment below)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message