hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "vinisha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-5732) Add SFTP FileSystem
Date Wed, 31 May 2017 23:06:04 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032167#comment-16032167

vinisha commented on HADOOP-5732:

I am using hadoop 2.8 and seeing below exception in my mapreduce job. What would be the reason
for it? Is there any work around?
Failed to initialize batch source 'FTP' with the error: No FileSystem for scheme: sftp. Please
review your pipeline configuration and check the system logs for more details.
java.io.IOException: No FileSystem for scheme: sftp
	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2798) ~[org.apache.hadoop.hadoop-common-2.8.0.jar:na]
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2809) ~[org.apache.hadoop.hadoop-common-2.8.0.jar:na]
	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:100) ~[org.apache.hadoop.hadoop-common-2.8.0.jar:na]
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2848) ~[org.apache.hadoop.hadoop-common-2.8.0.jar:na]
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2830) ~[org.apache.hadoop.hadoop-common-2.8.0.jar:na]
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:389) ~[org.apache.hadoop.hadoop-common-2.8.0.jar:na]

> Add SFTP FileSystem
> -------------------
>                 Key: HADOOP-5732
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5732
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>         Environment: Any environment
>            Reporter: Íñigo Goiri
>            Assignee: ramtin
>            Priority: Minor
>             Fix For: 2.8.0, 3.0.0-alpha1
>         Attachments: HADOOP-5732.008.patch, HADOOP-5732.009.patch, HADOOP-5732.010.patch,
HADOOP-5732.patch, HADOOP-5732.patch, HADOOP-5732.patch, HADOOP-5732.patch, HADOOP-5732.patch,
ivy-for-hadoop-7532.patch, ivy-for-hadoop-7532.patch
>   Original Estimate: 0h
>  Remaining Estimate: 0h
> I have implemented a FileSystem that supports SFTP. It uses JSch (http://www.jcraft.com/jsch/)
in order to manage SFTP.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message