hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9613) Minor improvement and clean up in distcp
Date Tue, 05 Jan 2016 07:52:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082599#comment-15082599

Kai Zheng commented on HDFS-9613:

Hi Yongjun, I have a question in understanding the current codes. When performing the coping,
if the checksum opt and block size can be not preserved, or used for the target file, why
it would compare the file checksums after the copy? It will be likely different, right? Thanks
for the help.

> Minor improvement and clean up in distcp
> ----------------------------------------
>                 Key: HDFS-9613
>                 URL: https://issues.apache.org/jira/browse/HDFS-9613
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Kai Zheng
>            Assignee: Kai Zheng
>            Priority: Minor
>         Attachments: HDFS-9613-v1.patch
> While working on related issue, it was noticed there are some places in {{distcp}} that's
better to be improved and cleaned up. Particularly, after a file is coped to target cluster,
it will check the copied file is fine or not. When checking, better to check block size first,
then the checksum, because the later is a little expensive.

This message was sent by Atlassian JIRA

View raw message