Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1D2F0200D33 for ; Wed, 8 Nov 2017 21:37:07 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 1BBB4160BDA; Wed, 8 Nov 2017 20:37:07 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E22D11609E0 for ; Wed, 8 Nov 2017 21:37:05 +0100 (CET) Received: (qmail 89077 invoked by uid 500); 8 Nov 2017 20:37:05 -0000 Mailing-List: contact notifications-help@libcloud.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@libcloud.apache.org Delivered-To: mailing list notifications@libcloud.apache.org Received: (qmail 89062 invoked by uid 99); 8 Nov 2017 20:37:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Nov 2017 20:37:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 4B89DD2C81 for ; Wed, 8 Nov 2017 20:37:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id qndz_cGXgyO5 for ; Wed, 8 Nov 2017 20:37:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 772B460F95 for ; Wed, 8 Nov 2017 20:37:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id A580AE05B7 for ; Wed, 8 Nov 2017 20:37:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 34DDA23F05 for ; Wed, 8 Nov 2017 20:37:00 +0000 (UTC) Date: Wed, 8 Nov 2017 20:37:00 +0000 (UTC) From: "David L. Day (JIRA)" To: notifications@libcloud.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (LIBCLOUD-959) AZURE_BLOBS upload_object fails on both Container and Driver MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 08 Nov 2017 20:37:07 -0000 [ https://issues.apache.org/jira/browse/LIBCLOUD-959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David L. Day updated LIBCLOUD-959: ---------------------------------- Description: The upload_object method on both the driver and container objects fails for Provider.AZURE_BLOBS. Listing containers and objects works. {noformat} > pip list Package Version --------------- --------- apache-libcloud 2.2.1 asn1crypto 0.23.0 certifi 2017.11.5 cffi 1.11.2 chardet 3.0.4 cryptography 2.1.3 enum34 1.1.6 idna 2.6 ipaddress 1.0.18 pip 9.0.1 pycparser 2.18 pyOpenSSL 17.3.0 requests 2.18.4 setuptools 36.6.0 six 1.11.0 urllib3 1.22 wheel 0.30.0 {noformat} Code to reproduce: {code:python} # -*- coding: utf-8 -*- import libcloud.security from libcloud.storage.types import Provider from libcloud.storage.providers import get_driver key = '' secret = '' cls = get_driver(Provider.AZURE_BLOBS) driver = cls(key=key, secret=secret) print "Containers: ", driver.list_containers() testing = driver.get_container(container_name='testing') print "Objects in 'testing': ", testing.list_objects() print "Downloading LICENSE.txt:" lic = testing.get_object('LICENSE.txt') testing.download_object(lic, 'C:\\Users\\dayd3\\Downloads\\LICENSE.txt') print "Uploading via driver:" driver.upload_object(file_path='C:\\Users\\dayd3\\Downloads\\test.txt', container=testing, object_name='test/test.txt') print "Uploading via container:" testing.upload_object(file_path='C:\\Users\\dayd3\\Downloads\\test.txt', object_name='test/test.txt')}} {code} Error: {noformat} > python azure.py Containers: [] Objects in 'testing': [] Uploading via driver: Traceback (most recent call last): File "azure.py", line 15, in driver.upload_object(file_path='C:\\Users\\dayd3\\Downloads\\test.txt', container=testing, object_name='test/test.txt') File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\drivers\azure_blobs.py", line 771, in upload_object use_lease=ex_use_lease) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\drivers\azure_blobs.py", line 895, in _put_object stream=stream) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\base.py", line 627, in _upload_object headers=headers, raw=True) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\common\base.py", line 590, in request stream=stream) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\http.py", line 230, in prepared_request verify=self.ca_cert if self.ca_cert is not None else self.verify) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\sessions.py", line 618, in send r = adapter.send(request, **kwargs) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\adapters.py", line 508, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPSConnectionPool(host='dmainnovbdl1.blob.core.windows.net', port=443): Max retries exceeded with url: /testing/test/test.txt (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 11004] getaddrinfo failed',)) {noformat} I'm receiving the same problem with download_object. I've updated the code sample above, and here's the output: {noformat} Containers: [] Objects in 'testing': [] Downloading LICENSE.txt: Traceback (most recent call last): File "azure.py", line 16, in testing.download_object(lic, 'C:\\Users\\dayd3\\Downloads\\LICENSE.txt') File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\base.py", line 162, in download_object delete_on_failure=delete_on_failure) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\drivers\azure_blobs.py", line 546, in download_object response = self.connection.request(obj_path, raw=True, data=None) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\common\base.py", line 590, in request stream=stream) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\http.py", line 230, in prepared_request verify=self.ca_cert if self.ca_cert is not None else self.verify) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\sessions.py", line 618, in send r = adapter.send(request, **kwargs) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\adapters.py", line 508, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPSConnectionPool(host='dmainnovbdl1.blob.core.windows.net', port=443): Max retries exceeded wi th url: /testing/LICENSE.txt (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 11004] getaddrinfo failed',)) {noformat} was: The upload_object method on both the driver and container objects fails for Provider.AZURE_BLOBS. Listing containers and objects works. {noformat} > pip list Package Version --------------- --------- apache-libcloud 2.2.1 asn1crypto 0.23.0 certifi 2017.11.5 cffi 1.11.2 chardet 3.0.4 cryptography 2.1.3 enum34 1.1.6 idna 2.6 ipaddress 1.0.18 pip 9.0.1 pycparser 2.18 pyOpenSSL 17.3.0 requests 2.18.4 setuptools 36.6.0 six 1.11.0 urllib3 1.22 wheel 0.30.0 {noformat} Code to reproduce: {code:python} # -*- coding: utf-8 -*- import libcloud.security from libcloud.storage.types import Provider from libcloud.storage.providers import get_driver key = '' secret = '' cls = get_driver(Provider.AZURE_BLOBS) driver = cls(key=key, secret=secret) print "Containers: ", driver.list_containers() testing = driver.get_container(container_name='testing') print "Objects in 'testing': ", testing.list_objects() print "Uploading via driver:" driver.upload_object(file_path='C:\\Users\\dayd3\\Downloads\\test.txt', container=testing, object_name='test/test.txt') print "Uploading via container:" testing.upload_object(file_path='C:\\Users\\dayd3\\Downloads\\test.txt', object_name='test/test.txt')}} {code} Error: {noformat} > python azure.py Containers: [] Objects in 'testing': [] Uploading via driver: Traceback (most recent call last): File "azure.py", line 15, in driver.upload_object(file_path='C:\\Users\\dayd3\\Downloads\\test.txt', container=testing, object_name='test/test.txt') File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\drivers\azure_blobs.py", line 771, in upload_object use_lease=ex_use_lease) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\drivers\azure_blobs.py", line 895, in _put_object stream=stream) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\base.py", line 627, in _upload_object headers=headers, raw=True) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\common\base.py", line 590, in request stream=stream) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\http.py", line 230, in prepared_request verify=self.ca_cert if self.ca_cert is not None else self.verify) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\sessions.py", line 618, in send r = adapter.send(request, **kwargs) File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\adapters.py", line 508, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPSConnectionPool(host='dmainnovbdl1.blob.core.windows.net', port=443): Max retries exceeded with url: /testing/test/test.txt (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 11004] getaddrinfo failed',)) {noformat} > AZURE_BLOBS upload_object fails on both Container and Driver > ------------------------------------------------------------ > > Key: LIBCLOUD-959 > URL: https://issues.apache.org/jira/browse/LIBCLOUD-959 > Project: Libcloud > Issue Type: Bug > Components: Storage > Environment: Python 2.7.11 > Reporter: David L. Day > > The upload_object method on both the driver and container objects fails for Provider.AZURE_BLOBS. Listing containers and objects works. > {noformat} > > pip list > Package Version > --------------- --------- > apache-libcloud 2.2.1 > asn1crypto 0.23.0 > certifi 2017.11.5 > cffi 1.11.2 > chardet 3.0.4 > cryptography 2.1.3 > enum34 1.1.6 > idna 2.6 > ipaddress 1.0.18 > pip 9.0.1 > pycparser 2.18 > pyOpenSSL 17.3.0 > requests 2.18.4 > setuptools 36.6.0 > six 1.11.0 > urllib3 1.22 > wheel 0.30.0 > {noformat} > Code to reproduce: > {code:python} > # -*- coding: utf-8 -*- > import libcloud.security > from libcloud.storage.types import Provider > from libcloud.storage.providers import get_driver > key = '' > secret = '' > cls = get_driver(Provider.AZURE_BLOBS) > driver = cls(key=key, secret=secret) > print "Containers: ", driver.list_containers() > testing = driver.get_container(container_name='testing') > print "Objects in 'testing': ", testing.list_objects() > print "Downloading LICENSE.txt:" > lic = testing.get_object('LICENSE.txt') > testing.download_object(lic, 'C:\\Users\\dayd3\\Downloads\\LICENSE.txt') > print "Uploading via driver:" > driver.upload_object(file_path='C:\\Users\\dayd3\\Downloads\\test.txt', container=testing, object_name='test/test.txt') > print "Uploading via container:" > testing.upload_object(file_path='C:\\Users\\dayd3\\Downloads\\test.txt', object_name='test/test.txt')}} > {code} > Error: > {noformat} > > python azure.py > Containers: [] > Objects in 'testing': [] > Uploading via driver: > Traceback (most recent call last): > File "azure.py", line 15, in > driver.upload_object(file_path='C:\\Users\\dayd3\\Downloads\\test.txt', container=testing, object_name='test/test.txt') > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\drivers\azure_blobs.py", line 771, in upload_object > use_lease=ex_use_lease) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\drivers\azure_blobs.py", line 895, in _put_object > stream=stream) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\base.py", line 627, in _upload_object > headers=headers, raw=True) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\common\base.py", line 590, in request > stream=stream) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\http.py", line 230, in prepared_request > verify=self.ca_cert if self.ca_cert is not None else self.verify) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\sessions.py", line 618, in send > r = adapter.send(request, **kwargs) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\adapters.py", line 508, in send > raise ConnectionError(e, request=request) > requests.exceptions.ConnectionError: HTTPSConnectionPool(host='dmainnovbdl1.blob.core.windows.net', port=443): Max retries exceeded with url: /testing/test/test.txt (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 11004] getaddrinfo failed',)) > {noformat} > I'm receiving the same problem with download_object. I've updated the code sample above, and here's the output: > {noformat} > Containers: [] > Objects in 'testing': [] > Downloading LICENSE.txt: > Traceback (most recent call last): > File "azure.py", line 16, in > testing.download_object(lic, 'C:\\Users\\dayd3\\Downloads\\LICENSE.txt') > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\base.py", line 162, in download_object > delete_on_failure=delete_on_failure) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\storage\drivers\azure_blobs.py", line 546, in download_object > response = self.connection.request(obj_path, raw=True, data=None) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\common\base.py", line 590, in request > stream=stream) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\libcloud\http.py", line 230, in prepared_request > verify=self.ca_cert if self.ca_cert is not None else self.verify) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\sessions.py", line 618, in send > r = adapter.send(request, **kwargs) > File "C:\Users\dayd3\Envs\libcloud\lib\site-packages\requests\adapters.py", line 508, in send > raise ConnectionError(e, request=request) > requests.exceptions.ConnectionError: HTTPSConnectionPool(host='dmainnovbdl1.blob.core.windows.net', port=443): Max retries exceeded wi > th url: /testing/LICENSE.txt (Caused by NewConnectionError(': > Failed to establish a new connection: [Errno 11004] getaddrinfo failed',)) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)