hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Georgi Chalakov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14536) Update azure-storage sdk to version 5.3.0
Date Mon, 19 Jun 2017 22:11:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054832#comment-16054832

Georgi Chalakov commented on HADOOP-14536:

 T E S T S
Results :

Tests run: 704, Failures: 0, Errors: 0, Skipped: 119

> Update azure-storage sdk to version 5.3.0
> -----------------------------------------
>                 Key: HADOOP-14536
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14536
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/azure
>    Affects Versions: 3.0.0-alpha3
>            Reporter: Mingliang Liu
>            Assignee: Georgi Chalakov
>         Attachments: HADOOP-14536-01.patch
> Update WASB driver to use the latest version (5.3.0) of SDK for Microsoft Azure Storage
Clients. We are currently using version 4.2.0 of the SDK.
> Azure Storage Clients changes between 4.2 and 5.3:
>  * Fixed a bug where the transactional MD5 check would fail when downloading a range
of blob or file and the recovery action is performed on a subsection of the range.
>  * Fixed leaking connections for table requests.
>  * Fixed a bug where retries happened immediately when experiencing a network exception
uploading data or getting the response.
>  * Fixed a bug where the response stream was not being closed on nonretryable exceptions.
>  * Fixed Exists() calls on Shares and Directories to now populate metadata. This was
already being done for Files.
>  * Changed blob constants to support up to 256 MB on put blob for block blobs. The default
value for put blob threshold has also been updated to half of the maximum, or 128 MB currently.
>  * Fixed a bug that prevented setting content MD5 to true when creating a new file.
>  * Fixed a bug where access conditions, options, and operation context were not being
passed when calling openWriteExisting() on a page blob or a file.
>  * Fixed a bug where an exception was being thrown on a range get of a blob or file when
the options disableContentMD5Validation is set to false and useTransactionalContentMD5 is
set to true and there is no overall MD5.
>  * Fixed a bug where retries were happening immediately if a socket exception was thrown.
>  * In CloudFileShareProperties, setShareQuota() no longer asserts in bounds. This check
has been moved to create() and uploadProperties() in CloudFileShare.
>  * Prefix support for listing files and directories.
>  * Added support for setting public access when creating a blob container
>  * The public access setting on a blob container is now a container property returned
from downloadProperties.
>  * Add Message now modifies the PopReceipt, Id, NextVisibleTime, InsertionTime, and ExpirationTime
properties of its CloudQueueMessage parameter.
>  * Populate content MD5 for range gets on Blobs and Files.
>  * Added support in Page Blob for incremental copy.
>  * Added large BlockBlob upload support. Blocks can now support sizes up to 100 MB.
>  * Added a new, memory-optimized upload strategy for the upload* APIs. This algorithm
only applies for blocks greater than 4MB and when storeBlobContentMD5 and Client-Side Encryption
are disabled.
>  * getQualifiedUri() has been deprecated for Blobs. Please use getSnapshotQualifiedUri()
instead. This new function will return the blob including the snapshot (if present) and no
SAS token.
>  * getQualifiedStorageUri() has been deprecated for Blobs. Please use getSnapshotQualifiedStorageUri()
instead. This new function will return the blob including the snapshot (if present) and no
SAS token.
>  * Fixed a bug where copying from a blob that included a SAS token and a snapshot ommitted
the SAS token.
>  * Fixed a bug in client-side encryption for tables that was preventing the Java client
from decrypting entities encrypted with the .NET client, and vice versa.
>  * Added support for server-side encryption.
>  * Added support for getBlobReferenceFromServer methods on CloudBlobContainer to support
retrieving a blob without knowing its type.
>  * Fixed a bug in the retry policies where 300 status codes were being retried when they
shouldn't be.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message