hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ray Chiang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6121) JobResourceUpdater#compareFs() doesn't handle HA namespaces
Date Wed, 01 Jul 2015 17:30:05 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610677#comment-14610677
] 

Ray Chiang commented on MAPREDUCE-6121:
---------------------------------------

Thanks for the quick review and commit!

> JobResourceUpdater#compareFs() doesn't handle HA namespaces
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-6121
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6121
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.5.0
>            Reporter: Thomas Graves
>            Assignee: Ray Chiang
>             Fix For: 2.8.0
>
>         Attachments: MAPREDUCE-6121.001.patch, MAPREDUCE-6121.002.patch, MAPREDUCE-6121.003.patch
>
>
> Looking at the JobSubmitter.compareFs it doesn't look like it properly handles HA namespaces.
 The code tries to lookup the hostname using InetAddress.getByName, but if you are using namespaces
this is going to fail and its going to copy the file when it doesn't need to. 
> Edit: JobSubmitter was updated to JobResourceUpdater in MAPREDUCE-6267.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message