hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharat Viswanadham (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDDS-659) Implement pagination in GET bucket (object list) endpoint
Date Tue, 30 Oct 2018 22:51:00 GMT

    [ https://issues.apache.org/jira/browse/HDDS-659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16669389#comment-16669389
] 

Bharat Viswanadham edited comment on HDDS-659 at 10/30/18 10:50 PM:
--------------------------------------------------------------------

Hi [~elek]

I have rebased the patch on top of HDDS-712.

I have added a few more test cases for continuation token and start after.

Patch is dependant on HDDS-712. 

 

Testing with aws cli is not working properly, I think aws cli is broken for list-object,
as when I give max-items it is not considering that one as max keys, and with continuation
token, it is not allowing me to list max-keys. (Same behavior with S3 and S3Gateway) So, I
have tested with curl with both S3 and our S3 Gateway endpoints.

 


was (Author: bharatviswa):
I have rebased the patch on top of HDDS-712.

I have added a few more test cases for continuation token and start after.

Patch is dependant on HDDS-712.

 

Testing with aws cli is not working properly, I think aws cli is broken for list-object,
as when I give max-items it is not considering that one as max keys, and with continuation
token, it is not allowing me to list max-keys. (Same behavior with S3 and S3Gateway) So, I
have tested with curl with both S3 and our S3 Gateway endpoints.

 

> Implement pagination in GET bucket (object list) endpoint
> ---------------------------------------------------------
>
>                 Key: HDDS-659
>                 URL: https://issues.apache.org/jira/browse/HDDS-659
>             Project: Hadoop Distributed Data Store
>          Issue Type: Sub-task
>            Reporter: Elek, Marton
>            Assignee: Bharat Viswanadham
>            Priority: Blocker
>         Attachments: HDDS-659.00-WIP.patch, HDDS-659.01.patch, HDDS-659.02.patch, HDDS-659.03.patch
>
>
> The current implementation always returns with all the elements. We need to support paging
with supporting the following headers:
>  * {{start-after}}
>  * {{continuation-token}}{{}}
>  * {{max-keys}}{{}}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message