hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6117) Hadoop ignores yarn.nodemanager.hostname for RPC listeners
Date Mon, 11 Sep 2017 05:11:01 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160709#comment-16160709
] 

Hadoop QA commented on MAPREDUCE-6117:
--------------------------------------

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m  0s{color} | {color:blue}
Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red}  0m  4s{color} | {color:red}
MAPREDUCE-6117 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute
for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | MAPREDUCE-6117 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12731616/MAPREDUCE-6117.002.patch
|
| Console output | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/7126/console |
| Powered by | Apache Yetus 0.5.0   http://yetus.apache.org |


This message was automatically generated.



> Hadoop ignores yarn.nodemanager.hostname for RPC listeners
> ----------------------------------------------------------
>
>                 Key: MAPREDUCE-6117
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6117
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: client, task
>    Affects Versions: 2.2.1, 2.4.1, 2.5.1
>         Environment: Any mapreduce example with standard cluster.  In our case each node
has four networks.  It is important that all internode communication be done on a specific
network.
>            Reporter: Waldyn Benbenek
>            Assignee: Waldyn Benbenek
>              Labels: BB2015-05-RFC
>         Attachments: MapReduce-534.patch, MAPREDUCE-6117.002.patch
>
>   Original Estimate: 48h
>          Time Spent: 384h
>  Remaining Estimate: 0h
>
> The RPC listeners for an application are using the hostname of the node as the binding
address of the listener,  They ignore yarn.nodemanager.hostname for this.  In our setup we
want all communication between nodes to be done via the network addresses we specify in yarn.nodemanager.hostname
on each node.  
> TaskAttemptListenerImpl.java and MRClientService.java are two places I have found where
the default address is used rather that NM_host.   The node Manager hostname should be used
for all communication between nodes including the RPC listeners.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message