Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 78D6418464 for ; Thu, 25 Jun 2015 19:07:05 +0000 (UTC) Received: (qmail 79090 invoked by uid 500); 25 Jun 2015 19:07:05 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 79026 invoked by uid 500); 25 Jun 2015 19:07:05 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 79013 invoked by uid 99); 25 Jun 2015 19:07:05 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Jun 2015 19:07:05 +0000 Date: Thu, 25 Jun 2015 19:07:05 +0000 (UTC) From: "Hadoop QA (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (MAPREDUCE-6121) JobSubmitter.compareFs doesn't handle HA namespaces MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-6121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601756#comment-14601756 ] Hadoop QA commented on MAPREDUCE-6121: -------------------------------------- \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | pre-patch | 18m 52s | Pre-patch trunk compilation is healthy. | | {color:green}+1{color} | @author | 0m 0s | The patch does not contain any @author tags. | | {color:green}+1{color} | tests included | 0m 0s | The patch appears to include 1 new or modified test files. | | {color:green}+1{color} | javac | 7m 48s | There were no new javac warning messages. | | {color:green}+1{color} | javadoc | 10m 1s | There were no new javadoc warning messages. | | {color:green}+1{color} | release audit | 0m 22s | The applied patch does not increase the total number of release audit warnings. | | {color:green}+1{color} | checkstyle | 2m 5s | There were no new checkstyle issues. | | {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that end in whitespace. | | {color:green}+1{color} | install | 1m 35s | mvn install still works. | | {color:green}+1{color} | eclipse:eclipse | 0m 32s | The patch built with eclipse:eclipse. | | {color:green}+1{color} | findbugs | 4m 2s | The patch does not introduce any new Findbugs (version 3.0.0) warnings. | | {color:green}+1{color} | common tests | 22m 45s | Tests passed in hadoop-common. | | {color:green}+1{color} | mapreduce tests | 1m 44s | Tests passed in hadoop-mapreduce-client-core. | | {color:green}+1{color} | tools/hadoop tests | 6m 17s | Tests passed in hadoop-distcp. | | | | 76m 7s | | \\ \\ || Subsystem || Report/Notes || | Patch URL | http://issues.apache.org/jira/secure/attachment/12741901/MAPREDUCE-6121.002.patch | | Optional Tests | javadoc javac unit findbugs checkstyle | | git revision | trunk / 67a62da | | hadoop-common test log | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5841/artifact/patchprocess/testrun_hadoop-common.txt | | hadoop-mapreduce-client-core test log | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5841/artifact/patchprocess/testrun_hadoop-mapreduce-client-core.txt | | hadoop-distcp test log | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5841/artifact/patchprocess/testrun_hadoop-distcp.txt | | Test Results | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5841/testReport/ | | Java | 1.7.0_55 | | uname | Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux | | Console output | https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5841/console | This message was automatically generated. > JobSubmitter.compareFs doesn't handle HA namespaces > --------------------------------------------------- > > Key: MAPREDUCE-6121 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6121 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 > Affects Versions: 2.5.0 > Reporter: Thomas Graves > Assignee: Ray Chiang > Attachments: MAPREDUCE-6121.001.patch, MAPREDUCE-6121.002.patch > > > Looking at the JobSubmitter.compareFs it doesn't look like it properly handles HA namespaces. The code tries to lookup the hostname using InetAddress.getByName, but if you are using namespaces this is going to fail and its going to copy the file when it doesn't need to. -- This message was sent by Atlassian JIRA (v6.3.4#6332)