hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6117) Hadoop ignores yarn.nodemanager.hostname for RPC listeners
Date Sun, 03 May 2015 04:12:06 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525637#comment-14525637
] 

Hadoop QA commented on MAPREDUCE-6117:
--------------------------------------

\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch |  15m 10s | Pre-patch trunk compilation is healthy. |
| {color:green}+1{color} | @author |   0m  0s | The patch does not contain any @author tags.
|
| {color:green}+1{color} | tests included |   0m  0s | The patch appears to include 1 new
or modified test files. |
| {color:green}+1{color} | javac |   7m 44s | There were no new javac warning messages. |
| {color:red}-1{color} | javadoc |   9m 58s | The applied patch generated  8  additional warning
messages. |
| {color:green}+1{color} | release audit |   0m 22s | The applied patch does not increase
the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle |   0m 36s | The applied patch generated  8 new checkstyle
issues (total was 45, now 53). |
| {color:red}-1{color} | whitespace |   0m  0s | The patch has 1  line(s) that end in whitespace.
Use git apply --whitespace=fix. |
| {color:green}+1{color} | install |   1m 36s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse |   0m 33s | The patch built with eclipse:eclipse.
|
| {color:green}+1{color} | findbugs |   0m 55s | The patch does not introduce any new Findbugs
(version 2.0.3) warnings. |
| {color:green}+1{color} | mapreduce tests |   9m 17s | Tests passed in hadoop-mapreduce-client-app.
|
| | |  46m 14s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL | http://issues.apache.org/jira/secure/attachment/12675078/MapReduce-534.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / e8d0ee5 |
| javadoc | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5619/artifact/patchprocess/diffJavadocWarnings.txt
|
| checkstyle |  https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5619/artifact/patchprocess/diffcheckstylehadoop-mapreduce-client-app.txt
|
| whitespace | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5619/artifact/patchprocess/whitespace.txt
|
| hadoop-mapreduce-client-app test log | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5619/artifact/patchprocess/testrun_hadoop-mapreduce-client-app.txt
|
| Test Results | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5619/testReport/
|
| Java | 1.7.0_55 |
| uname | Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep
3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5619/console |


This message was automatically generated.

> Hadoop ignores yarn.nodemanager.hostname for RPC listeners
> ----------------------------------------------------------
>
>                 Key: MAPREDUCE-6117
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6117
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: client, task
>    Affects Versions: 2.2.1, 2.4.1, 2.5.1
>         Environment: Any mapreduce example with standard cluster.  In our case each node
has four networks.  It is important that all internode communication be done on a specific
network.
>            Reporter: Waldyn Benbenek
>            Assignee: Waldyn Benbenek
>             Fix For: 2.5.1
>
>         Attachments: MapReduce-534.patch
>
>   Original Estimate: 48h
>          Time Spent: 384h
>  Remaining Estimate: 0h
>
> The RPC listeners for an application are using the hostname of the node as the binding
address of the listener,  They ignore yarn.nodemanager.hostname for this.  In our setup we
want all communication between nodes to be done via the network addresses we specify in yarn.nodemanager.hostname
on each node.  
> TaskAttemptListenerImpl.java and MRClientService.java are two places I have found where
the default address is used rather that NM_host.   The node Manager hostname should be used
for all communication between nodes including the RPC listeners.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message