hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "F. Theberge (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-655) test.py under particular directory Found checksum error
Date Thu, 13 May 2010 19:48:42 GMT

    [ https://issues.apache.org/jira/browse/HDFS-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12867229#action_12867229
] 

F. Theberge commented on HDFS-655:
----------------------------------

Same problem, using Hadoop 0.20.2: Checksum error trying to "-put" file toy.hash.temp, but
it works if I rename the file to toy.hash.temp.0 for example ...



> test.py under particular directory Found checksum error 
> --------------------------------------------------------
>
>                 Key: HDFS-655
>                 URL: https://issues.apache.org/jira/browse/HDFS-655
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs client
>    Affects Versions: 0.20.1
>         Environment: ubuntu 9.04, 32bit
>            Reporter: freestyler
>
> $ ~/hadoop/bin/hadoop fs -ls /test
> Found 1 items
> -rw-r--r--   2 freestyler supergroup          2 2009-09-25 10:39 /test/foo
> $ ls -l
> total 4
> -rw-r--r-- 1 freestyler freestyler 2 2009-09-25 10:44 test.py
> $ ~/hadoop/bin/hadoop fs -put test.py /test
> 09/09/25 10:53:56 INFO fs.FSInputChecker: Found checksum error: b[0, 2]=610a
> org.apache.hadoop.fs.ChecksumException: Checksum error: test.py at 0
>         at org.apache.hadoop.fs.FSInputChecker.verifySum(FSInputChecker.java:277)
>         at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:241)
>         at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:189)
>         at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:158)
>         at java.io.DataInputStream.read(DataInputStream.java:83)
>         at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:47)
>         at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:85)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:209)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:155)
>         at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1172)
>         at org.apache.hadoop.fs.FsShell.copyFromLocal(FsShell.java:130)
>         at org.apache.hadoop.fs.FsShell.run(FsShell.java:1747)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>         at org.apache.hadoop.fs.FsShell.main(FsShell.java:1880)
> put: Checksum error: test.py at 0
> $ ~/hadoop/bin/hadoop fs -ls /test
> Found 2 items
> -rw-r--r--   2 freestyler supergroup          2 2009-09-25 10:39 /test/foo
> -rw-r--r--   2 freestyler supergroup          0 2009-09-25 10:53 /test/test.py
> $ cat test.py
> a
> $ cp test.py  bar                 
> $ ~/hadoop/bin/hadoop fs -put bar /test
> $ ~/hadoop/bin/hadoop fs -ls /test
> Found 3 items
> -rw-r--r--   2 freestyler supergroup          2 2009-09-25 10:56 /test/bar
> -rw-r--r--   2 freestyler supergroup          2 2009-09-25 10:39 /test/foo
> -rw-r--r--   2 freestyler supergroup          0 2009-09-25 10:53 /test/test.py
> But theses things won't happen in different directories.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message