[ https://issues.apache.org/jira/browse/HADOOP-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HADOOP-1491.
--------------------------------------
Resolution: Duplicate
Duplicate of HADOOP-1396.
> After successful distcp, couple of checksum error files
> -------------------------------------------------------
>
> Key: HADOOP-1491
> URL: https://issues.apache.org/jira/browse/HADOOP-1491
> Project: Hadoop
> Issue Type: Bug
> Components: util
> Affects Versions: 0.12.3
> Reporter: Koji Noguchi
> Assignee: dhruba borthakur
> Attachments: mapper1.txt, mapper2.txt
>
>
> Tried copying 700,000 files with distcp. 8 mappers per node. Single dfs.client.buffer.dir.
> Distcp ran on 25 nodes mapreduce.
> Couple of tasks failed, but job was successful.
> When checked, 12 files were corrupted. (Checksum error)
> This is repeatable.
> I'll add more information as we find.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
|