hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Koji Noguchi (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-1491) After successful distcp, couple of checksum error files
Date Wed, 13 Jun 2007 23:12:26 GMT
After successful distcp, couple of checksum error files
-------------------------------------------------------

                 Key: HADOOP-1491
                 URL: https://issues.apache.org/jira/browse/HADOOP-1491
             Project: Hadoop
          Issue Type: Bug
          Components: util
    Affects Versions: 0.12.3
            Reporter: Koji Noguchi


Tried copying 700,000 files  with distcp. 8 mappers per node.  Single dfs.client.buffer.dir.
Distcp ran on 25 nodes mapreduce.

Couple of tasks failed, but job was successful. 

When checked, 12  files were corrupted. (Checksum error)

This is repeatable.

I'll add more information as we find.





-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message