hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11762) Enable swift distcp to secure HDFS
Date Fri, 27 Mar 2015 02:44:53 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14383256#comment-14383256

Hadoop QA commented on HADOOP-11762:

{color:green}+1 overall{color}.  Here are the results of testing the latest attachment 
  against trunk revision 47782cb.

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified
test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
2.0.3) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:green}+1 core tests{color}.  The patch passed unit tests in hadoop-tools/hadoop-openstack.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/6009//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/6009//console

This message is automatically generated.

> Enable swift distcp to secure HDFS
> ----------------------------------
>                 Key: HADOOP-11762
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11762
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/swift
>    Affects Versions: 2.3.0, 2.4.0, 2.5.0, 2.4.1, 2.6.0, 2.5.1
>            Reporter: Chen He
>            Assignee: Chen He
>         Attachments: HADOOP-11762.000.patch
> Even we can use "dfs -put" or "dfs -cp" to move data between swift and secured HDFS,
it will be impractical for moving huge amount of data like 10TB or larger.
> Current Hadoop code will result in :"java.lang.IllegalArgumentException: java.net.UnknownHostException:
> Since it does not support token feature in SwiftNativeFileSystem right now, it will be
reasonable that we override the "getCanonicalServiceName" method like other filesystem extensions
(S3FileSystem, S3AFileSystem)

This message was sent by Atlassian JIRA

View raw message