Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Message-ID: <24814938.33021274325655193.JavaMail.jira@thor>
Date: Wed, 19 May 2010 23:20:55 -0400 (EDT)
From: "Bo Shi (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Subject: [jira] Commented: (HADOOP-5732) SFTP FileSystem
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/HADOOP-5732?page=3Dcom.atlassia=
n.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D128=
69461#action_12869461 ]=20

Bo Shi commented on HADOOP-5732:
--------------------------------

=C3=8D=C3=B1igo, thanks for the patch, it's saved us a ton of time :)

I had to make some adjustments the initialize() to get some things working.=
  In particular, in the last if/else block of initialize(), you have

      conf.set("fs.sftp.password." + host, null);

which, (in my 0.20.1 backport at least) will throw a null pointer exception=
 since configuration is backed by HashTable which doesn't allow null keys o=
r values in set().

We use public key authentication (not user and passwords) to connect, so it=
 might be nice to have the username default to ${user.name} if none is set =
instead of throwing an IOException.

With respect to Tom's comments about testing...

> Can this be done by having an embedded SFTP server

The MINA folks claim it takes five minutes: http://mina.apache.org/sshd/emb=
edding-sshd-in-5-minutes.html

I probably won't have much time in the next week or two to work on this but=
 I'm happy to work on it after I get some breathing room.


> SFTP FileSystem
> ---------------
>
>                 Key: HADOOP-5732
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5732
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 0.20.0
>         Environment: Any environment
>            Reporter: =C3=8D=C3=B1igo Goiri
>            Assignee: =C3=8D=C3=B1igo Goiri
>            Priority: Minor
>             Fix For: 0.21.0
>
>         Attachments: HADOOP-5732.patch, HADOOP-5732.patch, HADOOP-5732.pa=
tch, HADOOP-5732.patch, HADOOP-5732.patch, ivy-for-hadoop-7532.patch, ivy-f=
or-hadoop-7532.patch
>
>   Original Estimate: 0h
>  Remaining Estimate: 0h
>
> I have implemented a FileSystem that supports SFTP. It uses JSch (http://=
www.jcraft.com/jsch/) in order to manage SFTP.

--=20
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.