hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elek, Marton (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDDS-791) Support Range header for Oozne s3 object download
Date Fri, 02 Nov 2018 10:16:00 GMT
Elek, Marton created HDDS-791:

             Summary: Support Range header for Oozne s3 object download
                 Key: HDDS-791
                 URL: https://issues.apache.org/jira/browse/HDDS-791
             Project: Hadoop Distributed Data Store
          Issue Type: Sub-task
          Components: S3
            Reporter: Elek, Marton

Using s3 rest api smaller chunks of an object could be uploaded with using Range headers:

For example:

GET /example-object HTTP/1.1
Host: example-bucket.s3.amazonaws.com
x-amz-date: Fri, 28 Jan 2011 21:32:02 GMT
Range: bytes=0-9
Authorization: AWS AKIAIOSFODNN7EXAMPLE:Yxg83MZaEgh3OZ3l0rLo5RTX11o=
Sample Response with Specified Range of the Object Bytes

Can be implemented with using the seek method on OzoneInputStream.

The Range header  support is one of the missing piece for fully support s3a interface.

Range header spec:

Aws s3 doc:

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

View raw message