hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6121) JobResourceUpdater#compareFs() doesn't handle HA namespaces
Date Wed, 01 Jul 2015 16:14:07 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610566#comment-14610566
] 

Hudson commented on MAPREDUCE-6121:
-----------------------------------

SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #243 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/243/])
MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter)
(rkanter: rev 3a72bfd08281fd271bef4f41289125d39c41928c)
* hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobResourceUploader.java
* hadoop-mapreduce-project/CHANGES.txt


> JobResourceUpdater#compareFs() doesn't handle HA namespaces
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-6121
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6121
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.5.0
>            Reporter: Thomas Graves
>            Assignee: Ray Chiang
>             Fix For: 2.8.0
>
>         Attachments: MAPREDUCE-6121.001.patch, MAPREDUCE-6121.002.patch, MAPREDUCE-6121.003.patch
>
>
> Looking at the JobSubmitter.compareFs it doesn't look like it properly handles HA namespaces.
 The code tries to lookup the hostname using InetAddress.getByName, but if you are using namespaces
this is going to fail and its going to copy the file when it doesn't need to. 
> Edit: JobSubmitter was updated to JobResourceUpdater in MAPREDUCE-6267.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message