Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 13 Jun 2017 23:09:00 +0000 (UTC)
From: "Atul Sikaria (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <JIRA.13074294.1495565558000.13128.1497395340064@Atlassian.JIRA>
In-Reply-To: <JIRA.13074294.1495565558000@Atlassian.JIRA>
References: <JIRA.13074294.1495565558000@Atlassian.JIRA> <JIRA.13074294.1495565558321@jira-lw-us.apache.org>
Subject: [jira] [Comment Edited] (HADOOP-14450) ADLS Python client
 inconsistent when used in tandem with AdlFileSystem
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 13 Jun 2017 23:09:04 -0000


    [ https://issues.apache.org/jira/browse/HADOOP-14450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048510#comment-16048510 ] 

Atul Sikaria edited comment on HADOOP-14450 at 6/13/17 11:08 PM:
-----------------------------------------------------------------

The python tool with fix is released now. Run this to upgrade the command-line python tool:
run pip install azure-datalake-store --upgrade


was (Author: asikaria):
The pythin tool with fix is released now. Run this to upgrade the command-line python tool:
run pip install azure-datalake-store --upgrade


> ADLS Python client inconsistent when used in tandem with AdlFileSystem
> ----------------------------------------------------------------------
>
>                 Key: HADOOP-14450
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14450
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs/adl
>            Reporter: Sailesh Mukil
>            Assignee: Atul Sikaria
>              Labels: infrastructure
>
> Impala uses the AdlFileSystem connector to talk to ADLS. As a part of the Impala tests, we drop tables and verify that the files belonging to that table have been dropped for all filesystems that Impala supports. These tests however, fail with ADLS.
> If I use the Hadoop ADLS connector to delete a file, and then list the parent directory of that file using the above Python client within the second, the client still says that the file is available in ADLS.
> This is the Python client from Microsoft that we're using in our testing:
> https://github.com/Azure/azure-data-lake-store-python
> Their release notes say that it's still a "pre-release preview":
> https://github.com/Azure/azure-data-lake-store-python/releases
> Questions for the ADLS folks:
> Is this a known issue? If so, will it be fixed soon?
> Or is this expected behavior?
> I'm able to deterministically reproduce it in my tests, with Impala on ADLS.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org