hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5181) Add md5sum facility in dfsshell
Date Fri, 06 Feb 2009 08:04:04 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12671038#action_12671038

dhruba borthakur commented on HADOOP-5181:

dfsshell uses the dfs client, which in turn, verifies that the crc's match the data of the
file that is being fetched. There is a crc for every 512 bytes in the file. So, I am not sure
what additional verification is achieved by incorporating md5 in dfsshell.

> Add md5sum facility in dfsshell
> -------------------------------
>                 Key: HADOOP-5181
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5181
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: dfs
>            Reporter: zhangwei
> I think it would be usefull to add md5sum (or anyone else) to dfsshell ,and the facility
can verify the file on hdfs.It can confirm the file is integrity after copyFromLocal or copyToLocal.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message