From common-issues-return-13718-apmail-hadoop-common-issues-archive=hadoop.apache.org@hadoop.apache.org Thu Mar 24 15:37:43 2011 Return-Path: Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: (qmail 56834 invoked from network); 24 Mar 2011 15:37:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 24 Mar 2011 15:37:43 -0000 Received: (qmail 9303 invoked by uid 500); 24 Mar 2011 15:37:43 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 9139 invoked by uid 500); 24 Mar 2011 15:37:43 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 9131 invoked by uid 99); 24 Mar 2011 15:37:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Mar 2011 15:37:43 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Mar 2011 15:37:42 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id D1A054B6C4 for ; Thu, 24 Mar 2011 15:37:05 +0000 (UTC) Date: Thu, 24 Mar 2011 15:37:05 +0000 (UTC) From: "Daryn Sharp (JIRA)" To: common-issues@hadoop.apache.org Message-ID: <1820538773.8532.1300981025855.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HADOOP-7178) copyToLocal API is creating .crc files in local, even after setting verifyChecksum to false at client side. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010713#comment-13010713 ] Daryn Sharp commented on HADOOP-7178: ------------------------------------- The getlocal method is returning a LocalFileSystem, so if "fs" is declared as such, could the cast be removed? Regarding the getVerifyChecksum(), my concern is it's semantically wrong for all filesystems to claim (by default) that checksum files are supported. The default should be the truth. Granted, the implementation is backwards compatible, but future callers may operation on false assumptions of crc files. Would it be better to default as false in FileSystem, and ChecksumFileSystem overrides for true? I think this would also retain backwards compatibility? > copyToLocal API is creating .crc files in local, even after setting verifyChecksum to false at client side. > ----------------------------------------------------------------------------------------------------------- > > Key: HADOOP-7178 > URL: https://issues.apache.org/jira/browse/HADOOP-7178 > Project: Hadoop Common > Issue Type: Bug > Reporter: Uma Maheswara Rao G > Assignee: Uma Maheswara Rao G > Attachments: HADOOP-7178_COMMON.patch, HADOOP-7178_HDFS.patch > > > When we copy the files from DFS to local, it is creating the .crc file in local filesystem for the verification of checksum even if we disable the checksum verification at client side. > When user does not want to do any checksum verification, then what will be the use in creating of these files in local file system. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira