hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Gummadi (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-649) distcp should validate the data copied
Date Thu, 17 Sep 2009 09:54:57 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravi Gummadi updated MAPREDUCE-649:
-----------------------------------

    Attachment: d_verify649.v1.patch

Attaching patch that makes copy of file to be retried distcp.file.retries(with default value
of 3) times in case of failures. Failure could be failure of validation of copy(through file
checksums mismatch). These retries are at done within the same map irrespective of -i option.

Please review and provide your comments.

> distcp should validate the data copied
> --------------------------------------
>
>                 Key: MAPREDUCE-649
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-649
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: distcp
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>         Attachments: d_verify.patch, d_verify649.patch, d_verify649.v1.patch
>
>
> distcp should validate the files copied by checking the checksums, if the filesystem
supports checksums.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message