hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7178) FileSystem should have an option to control the .crc file creations at Local.
Date Mon, 01 Aug 2011 12:36:09 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073511#comment-13073511
] 

Uma Maheswara Rao G commented on HADOOP-7178:
---------------------------------------------

Hi Nicholas,

Thanks a lot for taking a look.

Removed the empty line.

Ant test patch results:
[exec] +1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
warnings.
     [exec] 
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9)
warnings.
     [exec] 
     [exec]     +1 release audit.  The applied patch does not increase the total number of
release audit warnings.
     [exec] 
     [exec]     +1 system test framework.  The patch passed system test framework compile.
     [exec] 
     [exec] 
     [exec] ======================================================================
     [exec] ======================================================================
     [exec]     Finished build.
     [exec] ======================================================================
     [exec] ======================================================================
     [exec] 

I verified manually, Tests are passing.

> FileSystem should have an option to control the .crc file creations at Local.
> -----------------------------------------------------------------------------
>
>                 Key: HADOOP-7178
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7178
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>         Attachments: HADOOP-7178.1.patch, HADOOP-7178.2.patch, HADOOP-7178.3.patch, HADOOP-7178.patch,
HADOOP-7178_COMMON.patch, HADOOP-7178_HDFS.patch
>
>
> When we copy the files from DFS to local, it is creating the .crc files in local filesystem
for the verification of checksum. When user dont want to do any check sum verifications, this
files will not be useful. 
> Command line already has an option ignoreCrc, to control this.
> So, we should have the similar option on FileSystem also..... like fs.ignoreCrc().
>  This should set the setVerifyChecksum to false and also should select the non CheckSumFileSystem
as local fs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message