hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bharat Viswanadham (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDDS-712) Use x-amz-storage-class to specify replication type and replication factor
Date Mon, 22 Oct 2018 23:44:00 GMT
Bharat Viswanadham created HDDS-712:
---------------------------------------

             Summary: Use x-amz-storage-class to specify replication type and replication
factor
                 Key: HDDS-712
                 URL: https://issues.apache.org/jira/browse/HDDS-712
             Project: Hadoop Distributed Data Store
          Issue Type: Task
            Reporter: Bharat Viswanadham
            Assignee: Bharat Viswanadham


 

This has been a comment in the Jira in HDDS-693 from 

@DefaultValue("STAND_ALONE") @QueryParam("replicationType")

Just an opportunistic comment. Not part of this patch, this query param will not be sent by
S3 hence this will always default to Stand_Alone. At some point we need to move to RATIS,
Perhaps we have to read this via x-amz-storage-class.

*I propose below solution for this:*

Currently, in code we take query params replicationType and replicationFactor and default
them to Stand alone and 1. But these query params cannot be passed from aws cli.

We want to use x-amz-storage-class header and pass the values. By default for S3 If you don't
specify this it defaults to Standard. So, in Ozone over S3 also, as we want to default to
Ratis and replication factor three by default.

We can use the mapping Standard to RATIS and REDUCED_REDUNDANCY to Stand alone.

 

There are 2 more values 

STANDARD_IA and ONEZONE_IA these need to be considered later how we want to use them. Intially we
are considering to use Standard and Reduced_Redundancy.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message