hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongjun Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-6491) proposal for developing a tool to compare files/dirs
Date Thu, 05 Jun 2014 17:49:02 GMT
Yongjun Zhang created HDFS-6491:

             Summary: proposal for developing a tool to compare files/dirs
                 Key: HDFS-6491
                 URL: https://issues.apache.org/jira/browse/HDFS-6491
             Project: Hadoop HDFS
          Issue Type: New Feature
          Components: tools
    Affects Versions: 2.4.0
            Reporter: Yongjun Zhang
            Assignee: Yongjun Zhang

We have a tool distcp that copy files similar to unix/linux cp command but copy files in a
distributed way, but we don't have a tool to compare files/dirs. I think to provide such a
tool like this would be helpful.  We can name it distdiff to be consistent with distcp.
Right now I'm thinking about providing some basic functionality as a starting point, and we
can add more features or add performance improvement later.

I had opportunity to discuss this with [~daryn] and [~szetszwo] in person. Thanks both of
them a lot for the very valuable inputs.

This message was sent by Atlassian JIRA

View raw message