From user-return-170-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Thu Jul 18 13:09:15 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 20E9B18063F for ; Thu, 18 Jul 2019 15:09:15 +0200 (CEST) Received: (qmail 41323 invoked by uid 500); 18 Jul 2019 13:09:05 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 41237 invoked by uid 99); 18 Jul 2019 13:09:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Jul 2019 13:09:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id D6E85C26B7 for ; Thu, 18 Jul 2019 13:08:59 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.301 X-Spam-Level: ** X-Spam-Status: No, score=2.301 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FROM_EXCESS_BASE64=0.001, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id t4FlTNHlEl8e for ; Thu, 18 Jul 2019 13:08:57 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::229; helo=mail-lj1-x229.google.com; envelope-from=awpkrabanoob@gmail.com; receiver= Received: from mail-lj1-x229.google.com (mail-lj1-x229.google.com [IPv6:2a00:1450:4864:20::229]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 614017DC5D for ; Thu, 18 Jul 2019 13:08:57 +0000 (UTC) Received: by mail-lj1-x229.google.com with SMTP id v24so27316207ljg.13 for ; Thu, 18 Jul 2019 06:08:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=lkLnNsjN0+f5yrhS7mAf9EbjfZYWPiEMyrtPIkD0mIU=; b=E/PLcbfwC8Mr0kK/18S1tmU6Z8FNqr4d/JD5MwHDnHg1F8UAydglSLFmoiwXSxmmZY TNZ+L+clsl00x/yIG8HnhAJLGxDvsbV0L9bZh52qTQxrRy2SbtVWD00w9j+XCEeSSycV rhLayk7imUfNzUmwt5wWqv0RXlvX4b+80Rt5xMoXzvPnhh8L6dsMa/luniIYwgugN61E 3hyvdl1H7M/oz1mcxtT2drRoXjNLfcK4Jx5UIRMGj376c8eke4QjhKoL6zL30HKcTuSl ixyPyFeAs/G2jd3J9rz3nKLNTX+uWfzFKZvoU6JAnQG+zagA68v20J/spRo1BCBy5DDj G55g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=lkLnNsjN0+f5yrhS7mAf9EbjfZYWPiEMyrtPIkD0mIU=; b=FSkrtR6RYrc3cbKd7cwu+cAZB1fyu0nrnl8mzEN1Yjn4HTmrTHttAO+m76SvsGER9U G3rI1oamtaICeIbMoVcjotcQVzj1K8m6kYL0E1nGaVoAS/E2xjwgqAeMqAfkvH66U9T9 hKaQJoL+Vedut0po7nHOpESKs3TwS3qMig3diW7bpEHItyfCf90Y7fcSljij7uKZJUAT w/kSNOyiBeTem4QfiKArW4pX0Vy69FILSucjYNoZ3VwnuXrcjy2SU27glv6mhuEMio6/ Ikq8vlK0HIWiVGBMyU6BrCRRa3TDq3CRTQOorCVQCt/d8HiBPTzS5XKbk6LNW62rSXee URew== X-Gm-Message-State: APjAAAUAQrY57D3uq5CRFOpE0/d4da1zXYAvwyZTPBXb2jK2f7jusDwy BdToIdlGz9Z6y48olb9+wREZGNxs/2fGcy4J3XiFmWLa29Q= X-Google-Smtp-Source: APXvYqxJBXwUHYLOnTCYMjBicnic/7q/9OFd+U70qbs31s++YeMz0rbTVfjyc/VkDlAOFlUv+a0XFl49i+jv0uwl/kc= X-Received: by 2002:a2e:3602:: with SMTP id d2mr24622438lja.112.1563455336164; Thu, 18 Jul 2019 06:08:56 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?B?0JjQs9C+0YDRjCDQmtGA0LDQstGH0LXQvdC60L4=?= Date: Thu, 18 Jul 2019 15:08:44 +0200 Message-ID: Subject: Re: PyArrow connect to Azure Data Lake Gen2 To: user@arrow.apache.org Content-Type: multipart/alternative; boundary="000000000000ef317c058df44fbb" --000000000000ef317c058df44fbb Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I just tried to access my account with the storefact, and unfortunately received the following error message: *OSError: Blob API is not yet supported for hierarchical namespace accounts. ErrorCode: BlobApiNotYetSupportedForHierarchicalNamespaceAccountsBlobApiNotYetSupportedForHierarchicalNames= paceAccountsBlob API is not yet supported for hierarchical namespace accounts.* =D1=81=D1=80, 17 =D0=BB=D0=B8=D0=BF. 2019 =D0=BE 14:12 =D0=98=D0=B3=D0=BE= =D1=80=D1=8C =D0=9A=D1=80=D0=B0=D0=B2=D1=87=D0=B5=D0=BD=D0=BA=D0=BE =D0=BF=D0=B8=D1=88=D0=B5: > Unfortunately I cannot use Python SDK to access Storage Gen2 anymore, > previously there was an option to access gen2 through gen's 1 API, but > Microsoft turned it off. I wanted to use hdfs because the amount of files > and size can really grow and I don't really want to load them to vm, but > process in memory. And I saw that abfs is supported by hdfs, it is fast a= nd > reliable, so this option seemed to be really convenient for this situatio= n, > maybe You can suggest something else, hope it doesn't looks too rude, I > really appreciate > > Thanks, > --000000000000ef317c058df44fbb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I just tried to access my account with the storefact, and = unfortunately received the following error message:
OSError: Blob AP= I is not yet supported for hierarchical namespace accounts. ErrorCode: Blob= ApiNotYetSupportedForHierarchicalNamespaceAccounts
<?xml version=3D&q= uot;1.0" encoding=3D"utf-8"?><Error><Code>Blo= bApiNotYetSupportedForHierarchicalNamespaceAccounts</Code><Message= >Blob API is not yet supported for hierarchical namespace accounts.<= br>


=D1=81=D1=80, 17 =D0=BB=D0=B8=D0=BF. 2019 = =D0=BE 14:12 =D0=98=D0=B3=D0=BE=D1=80=D1=8C =D0=9A=D1=80=D0=B0=D0=B2=D1=87= =D0=B5=D0=BD=D0=BA=D0=BE <awpk= rabanoob@gmail.com> =D0=BF=D0=B8=D1=88=D0=B5:
Unfortunately I canno= t use Python SDK to access Storage Gen2 anymore,=20 previously there was an option to access gen2 through gen's 1 API, but= =20 Microsoft turned it off. I wanted to use hdfs because the amount of=20 files and size can really grow and I don't really want to load them to= =20 vm, but process in memory. And I saw that abfs is supported by hdfs, it=20 is fast and reliable, so this option seemed to be really convenient for=20 this situation, maybe You can suggest something else, hope it doesn't= =20 looks too rude, I really appreciate

Thanks,=C2=A0
--000000000000ef317c058df44fbb--