hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ray Chiang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6121) JobResourceUpdater#compareFs() doesn't handle HA namespaces
Date Tue, 30 Jun 2015 22:11:05 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ray Chiang updated MAPREDUCE-6121:
----------------------------------
    Status: Open  (was: Patch Available)

Cancel testing due to dependency.

> JobResourceUpdater#compareFs() doesn't handle HA namespaces
> -----------------------------------------------------------
>
>                 Key: MAPREDUCE-6121
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6121
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.5.0
>            Reporter: Thomas Graves
>            Assignee: Ray Chiang
>         Attachments: MAPREDUCE-6121.001.patch, MAPREDUCE-6121.002.patch, MAPREDUCE-6121.003.patch
>
>
> Looking at the JobSubmitter.compareFs it doesn't look like it properly handles HA namespaces.
 The code tries to lookup the hostname using InetAddress.getByName, but if you are using namespaces
this is going to fail and its going to copy the file when it doesn't need to. 
> Edit: JobSubmitter was updated to JobResourceUpdater in MAPREDUCE-6267.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message