hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elek, Marton (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDDS-791) Support Range header for Oozne s3 object download
Date Fri, 02 Nov 2018 10:16:00 GMT
Elek, Marton created HDDS-791:
---------------------------------

             Summary: Support Range header for Oozne s3 object download
                 Key: HDDS-791
                 URL: https://issues.apache.org/jira/browse/HDDS-791
             Project: Hadoop Distributed Data Store
          Issue Type: Sub-task
          Components: S3
            Reporter: Elek, Marton


Using s3 rest api smaller chunks of an object could be uploaded with using Range headers:

For example:

{code}
GET /example-object HTTP/1.1
Host: example-bucket.s3.amazonaws.com
x-amz-date: Fri, 28 Jan 2011 21:32:02 GMT
Range: bytes=0-9
Authorization: AWS AKIAIOSFODNN7EXAMPLE:Yxg83MZaEgh3OZ3l0rLo5RTX11o=
Sample Response with Specified Range of the Object Bytes
{code}

Can be implemented with using the seek method on OzoneInputStream.

The Range header  support is one of the missing piece for fully support s3a interface.

References:
Range header spec:
https://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html#sec14.35

Aws s3 doc:
https://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectGET.html



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message