hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen He (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-11762) Enable swift distcp to secure HDFS
Date Fri, 27 Mar 2015 01:58:52 GMT
Chen He created HADOOP-11762:

             Summary: Enable swift distcp to secure HDFS
                 Key: HADOOP-11762
                 URL: https://issues.apache.org/jira/browse/HADOOP-11762
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs/swift
    Affects Versions: 2.5.1, 2.6.0, 2.4.1, 2.5.0, 2.4.0, 2.3.0
            Reporter: Chen He
            Assignee: Chen He

Even we can use "dfs -put" or "dfs -cp" to move data between swift and secured HDFS, it will
be impractical for moving huge amount of data like 10TB or larger.

Current Hadoop code will result in :"java.lang.IllegalArgumentException: java.net.UnknownHostException:

Since it does not support token feature in SwiftNativeFileSystem right now, it will be reasonable
that we override the "getCanonicalServiceName" method like other filesystem extensions (S3FileSystem,

This message was sent by Atlassian JIRA

View raw message