hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1957) Documentation for HFTP
Date Wed, 18 May 2011 22:18:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13035789#comment-13035789
] 

Todd Lipcon commented on HDFS-1957:
-----------------------------------

Thanks for writing this! A few comments:

bq. The reads are done via HTTPS,
I believe it only uses HTTP by default.

bq. <p>HFTP is primarily useful if you have multiple HDFS clusters and you need to move
data from one to another.</p>
Should point out its most common use case: HFTP is wire-compatible even between different
versions of HDFS - eg you can copy from a previous major release to a cluster running a new
one, which is not true of the hdfs:// protocol.


If possible, it would be nice to add a sample command line using distcp with hftp:// as the
source and hdfs:// as the destination. I bet if you search the mailing list you can find a
good example command line.

> Documentation for HFTP
> ----------------------
>
>                 Key: HDFS-1957
>                 URL: https://issues.apache.org/jira/browse/HDFS-1957
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs client
>    Affects Versions: 0.23.0
>            Reporter: Ari Rabkin
>            Assignee: Ari Rabkin
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: HDFS-1957.patch
>
>
> There should be some documentation for HFTP.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message