hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei-Chiu Chuang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9048) DistCp documentation is out-of-dated
Date Fri, 19 Feb 2016 02:44:18 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15153597#comment-15153597
] 

Wei-Chiu Chuang commented on HDFS-9048:
---------------------------------------

I think it's fine to commit this in 2.x. webhdfs is preferred than hftp even in 2.x.

However, webhdfs, unlike hftp, supports both read and write. So distcp does not need to run
on destination cluster.

> DistCp documentation is out-of-dated
> ------------------------------------
>
>                 Key: HDFS-9048
>                 URL: https://issues.apache.org/jira/browse/HDFS-9048
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Haohui Mai
>            Assignee: Daisuke Kobayashi
>         Attachments: HDFS-9048.patch
>
>
> There are a couple issues with the current distcp document:
> * It recommends hftp / hsftp filesystem to copy data between different hadoop version.
hftp / hsftp have been deprecated in the flavor of webhdfs.
> * If the users are copying between Hadoop 2.x they can use the hdfs protocol directly
for better performance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message