Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 75ED91720F for ; Fri, 8 Jan 2016 06:48:40 +0000 (UTC) Received: (qmail 15062 invoked by uid 500); 8 Jan 2016 06:48:40 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 15005 invoked by uid 500); 8 Jan 2016 06:48:40 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 14978 invoked by uid 99); 8 Jan 2016 06:48:40 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Jan 2016 06:48:40 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id DDAD82C1F5C for ; Fri, 8 Jan 2016 06:48:39 +0000 (UTC) Date: Fri, 8 Jan 2016 06:48:39 +0000 (UTC) From: "Kai Zheng (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-9613) Don't compare file checksums after copy if block size and checksum opt are not preserved for replicated files MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088792#comment-15088792 ] Kai Zheng commented on HDFS-9613: --------------------------------- HDFS-9630 is just opened to handle the refactoring things separately. > Don't compare file checksums after copy if block size and checksum opt are not preserved for replicated files > ------------------------------------------------------------------------------------------------------------- > > Key: HDFS-9613 > URL: https://issues.apache.org/jira/browse/HDFS-9613 > Project: Hadoop HDFS > Issue Type: Improvement > Reporter: Kai Zheng > Assignee: Kai Zheng > Priority: Minor > Attachments: HDFS-9613-v1.patch, HDFS-9613-v2.patch > > > While working on related issue, it was noticed there are some places in {{distcp}} that's better to be improved and cleaned up. Particularly, after a file is coped to target cluster, it will check the copied file is fine or not. For replicated files, when checking, if the source block size and checksum option are not preserved while copying, we can avoid comparing the file checksums, which may save some time. -- This message was sent by Atlassian JIRA (v6.3.4#6332)