hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2777) When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put fails due to a CRC mismatch
Date Thu, 12 Jan 2012 19:15:43 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13185154#comment-13185154
] 

Kihwal Lee commented on HDFS-2777:
----------------------------------

It is due to the change in the default behavior. FsShell for some reason now creates CRC files
(.<filename>.crc) in the local file system by default. Unaware of existence of the .filename.crc,
users can modify files stored in the local file system and make the CRC invalid. The default
behavior needs to be reverted back to ingnoreCrc.
                
> When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put
fails due to a CRC mismatch
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-2777
>                 URL: https://issues.apache.org/jira/browse/HDFS-2777
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs client
>    Affects Versions: 0.23.1
>         Environment: KR at Yahoo
>            Reporter: Kevin J. Price
>
> Performing an hdfs -get on a file, modifying the file, and using hdfs -put to place the
file back into HDFS results in a checksum error.  It seems that the problem is a .crc file
being generated locally from the -get command even though the -crc option was NOT specified.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message