hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3941) Extend FileSystem API to return file-checksums/file-digests
Date Fri, 05 Sep 2008 23:00:46 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12628786#action_12628786
] 

Tsz Wo (Nicholas), SZE commented on HADOOP-3941:
------------------------------------------------

I forgot to mention that the test failed is nothing to do with this issue.  See HADOOP-4078.

> Extend FileSystem API to return file-checksums/file-digests
> -----------------------------------------------------------
>
>                 Key: HADOOP-3941
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3941
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: fs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.19.0
>
>         Attachments: 3941_20080818.patch, 3941_20080819.patch, 3941_20080819b.patch,
3941_20080820.patch, 3941_20080826.patch, 3941_20080827.patch, 3941_20080904.patch
>
>
> Suppose we have two files in two locations (may be two clusters) and these two files
have the same size.  How could we tell whether the content of them are the same?
> Currently, the only way is to read both files and compare the content of them.  This
is a very expensive operation if the files are huge.
> So, we would like to extend the FileSystem API to support returning file-checksums/file-digests.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message