hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bo Shi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5732) SFTP FileSystem
Date Thu, 20 May 2010 03:20:55 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869461#action_12869461

Bo Shi commented on HADOOP-5732:

Íñigo, thanks for the patch, it's saved us a ton of time :)

I had to make some adjustments the initialize() to get some things working.  In particular,
in the last if/else block of initialize(), you have

      conf.set("fs.sftp.password." + host, null);

which, (in my 0.20.1 backport at least) will throw a null pointer exception since configuration
is backed by HashTable which doesn't allow null keys or values in set().

We use public key authentication (not user and passwords) to connect, so it might be nice
to have the username default to ${user.name} if none is set instead of throwing an IOException.

With respect to Tom's comments about testing...

> Can this be done by having an embedded SFTP server

The MINA folks claim it takes five minutes: http://mina.apache.org/sshd/embedding-sshd-in-5-minutes.html

I probably won't have much time in the next week or two to work on this but I'm happy to work
on it after I get some breathing room.

> SFTP FileSystem
> ---------------
>                 Key: HADOOP-5732
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5732
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 0.20.0
>         Environment: Any environment
>            Reporter: Íñigo Goiri
>            Assignee: Íñigo Goiri
>            Priority: Minor
>             Fix For: 0.21.0
>         Attachments: HADOOP-5732.patch, HADOOP-5732.patch, HADOOP-5732.patch, HADOOP-5732.patch,
HADOOP-5732.patch, ivy-for-hadoop-7532.patch, ivy-for-hadoop-7532.patch
>   Original Estimate: 0h
>  Remaining Estimate: 0h
> I have implemented a FileSystem that supports SFTP. It uses JSch (http://www.jcraft.com/jsch/)
in order to manage SFTP.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message