falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FALCON-889) Windows azure replication fails with "wasb" as the scheme to an HDFS file system
Date Wed, 12 Nov 2014 20:18:33 GMT

     [ https://issues.apache.org/jira/browse/FALCON-889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chris Nauroth updated FALCON-889:
---------------------------------
    Attachment: FALCON-889.1.patch

[~svenkat], thank you for pointing out this issue to me.  I'm attaching the proposed patch.

The problem is that Falcon tried to pass a {{Path}} (a URI) with "wasb" as the scheme to an
HDFS file system (class {{DistributedFileSystem}}) instead of a WASB file system (class {{NativeAzureFileSystem}}).
 We have validation checks in place to block this, because it could be disastrous to operate
on a path in an unintended file system by mistake.

Inside {{FileSystemStorage}}, the {{FileSystem}} instance was always created based on {{fs.defaultFS}}.
 Therefore, this code path was only working if the destination is the default file system.
 The patch changes the call to get the {{FileSystem}} so that it's sensitive to the specific
{{Path}} (and therefore its scheme).

> Windows azure replication fails with "wasb" as the scheme to an HDFS file system
> --------------------------------------------------------------------------------
>
>                 Key: FALCON-889
>                 URL: https://issues.apache.org/jira/browse/FALCON-889
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.6
>            Reporter: Venkatesh Seetharam
>            Assignee: Venkatesh Seetharam
>            Priority: Blocker
>             Fix For: 0.6
>
>         Attachments: FALCON-889.1.patch
>
>
> Thanks [~cnauroth] for finding the root cause of this issue. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message