hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chendong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-291) combine FsShell.copyToLocal to ChecksumFileSystem.copyToLocalFile
Date Tue, 20 Dec 2016 22:15:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15765403#comment-15765403
] 

chendong commented on HDFS-291:
-------------------------------

CopyToLocal is useful for us. We use this as a backup of whole HDFS data. 
We only have 500G HDFS data. That is not big data. 

We don't have much budget to create another cluster for backup purpose. 
So we backup the whole HDFS data into local file system.

This is a use case which seems not a typical big data scenario. However, as far as I know,
a lot of business start from small data with the requirement for the disaster recovery. 

> combine FsShell.copyToLocal to ChecksumFileSystem.copyToLocalFile
> -----------------------------------------------------------------
>
>                 Key: HDFS-291
>                 URL: https://issues.apache.org/jira/browse/HDFS-291
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Tsz Wo Nicholas Sze
>            Priority: Minor
>
> - Two methods provide similar functions
> - ChecksumFileSystem.copyToLocalFile(Path src, Path dst, boolean copyCrc) is no longer
used anywhere in the system
> - It is better to use ChecksumFileSystem.getRawFileSystem() for copying crc in FsShell.copyToLocal
> - FileSystem.isDirectory(Path) used in FsShell.copyToLocal is deprecated.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message