hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3246) FTP client over HDFS
Date Mon, 12 May 2008 23:24:55 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12596234#action_12596234
] 

Doug Cutting commented on HADOOP-3246:
--------------------------------------

Thanks!  This looks great!

Can you please attach the required jar files to this issue too?

Ideally the test service should specify zero as the port, so that the OS allocates a free
port, then we can ask which port was allocated and use that.  But it doesn't look as though
the Mina FTP server permits one to get the port that it's actually launched on.  So perhaps
we should try a few times in a loop, using a randomly generated port?  Otherwise we'll get
random test failures when that ports already in use, e.g., by another test run.

> FTP client over HDFS
> --------------------
>
>                 Key: HADOOP-3246
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3246
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: util
>    Affects Versions: 0.16.3
>            Reporter: Ankur
>            Priority: Minor
>         Attachments: ftpFileSystem.patch, ftpFileSystem_2.patch
>
>
> An FTP client that stores content directly into HDFS allows data from FTP serves to be
stored directly into HDFS instead of first copying the data locally and then uploading it
into HDFS. The benefits are apparent from an administrative perspective as large datasets
can be pulled from FTP servers with minimal human intervention.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message