hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Masatake Iwasaki (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9048) DistCp documentation is out-of-dated
Date Wed, 02 Mar 2016 14:04:18 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15175631#comment-15175631
] 

Masatake Iwasaki commented on HDFS-9048:
----------------------------------------

Thanks for the update [~daisuke.kobayashi].  If you prefer using configuration properties,
{{webhdfs://<dfs.http.address>:<http_port>}} should be {{webhdfs://<dfs.http.address>}}
since the value of dfs.http.address (and dfs.namenode.http-address which is the successor)
includes port number.

I'm +1 if this is addressed.

> DistCp documentation is out-of-dated
> ------------------------------------
>
>                 Key: HDFS-9048
>                 URL: https://issues.apache.org/jira/browse/HDFS-9048
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Haohui Mai
>            Assignee: Daisuke Kobayashi
>         Attachments: HDFS-9048-2.patch, HDFS-9048-3.patch, HDFS-9048.patch
>
>
> There are a couple issues with the current distcp document:
> * It recommends hftp / hsftp filesystem to copy data between different hadoop version.
hftp / hsftp have been deprecated in the flavor of webhdfs.
> * If the users are copying between Hadoop 2.x they can use the hdfs protocol directly
for better performance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message