hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDDS-712) Use x-amz-storage-class to specify replication type and replication factor
Date Wed, 31 Oct 2018 21:19:02 GMT

    [ https://issues.apache.org/jira/browse/HDDS-712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16670751#comment-16670751

Hudson commented on HDDS-712:

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15340 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/15340/])
HDDS-712. Use x-amz-storage-class to specify replication type and (elek: rev ecac351aac1702194c56743ced5a66242643f28c)
* (edit) hadoop-ozone/dist/src/main/smoketest/s3/objectdelete.robot
* (edit) hadoop-ozone/dist/src/main/smoketest/s3/objectputget.robot
* (edit) hadoop-ozone/dist/src/main/smoketest/s3/objectmultidelete.robot
* (edit) hadoop-ozone/dist/src/main/smoketest/s3/objectcopy.robot
* (edit) hadoop-ozone/s3gateway/src/test/java/org/apache/hadoop/ozone/s3/endpoint/TestPutObject.java
* (add) hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/util/S3StorageType.java
* (edit) hadoop-ozone/dist/src/main/smoketest/s3/awss3.robot
* (add) hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/util/package-info.java
* (edit) hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java
* (add) hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/util/S3Consts.java

> Use x-amz-storage-class to specify replication type and replication factor
> --------------------------------------------------------------------------
>                 Key: HDDS-712
>                 URL: https://issues.apache.org/jira/browse/HDDS-712
>             Project: Hadoop Distributed Data Store
>          Issue Type: Sub-task
>            Reporter: Bharat Viswanadham
>            Assignee: Bharat Viswanadham
>            Priority: Major
>         Attachments: HDDS-712.00.patch, HDDS-712.01.patch
> This has been a comment in the Jira in HDDS-693 from [~anu]
> @DefaultValue("STAND_ALONE") @QueryParam("replicationType")
> Just an opportunistic comment. Not part of this patch, this query param will not be sent
by S3 hence this will always default to Stand_Alone. At some point we need to move to RATIS,
Perhaps we have to read this via x-amz-storage-class.
> *I propose below solution for this:*
> Currently, in code we take query params replicationType and replicationFactor and default
them to Stand alone and 1. But these query params cannot be passed from aws cli.
> We want to use x-amz-storage-class header and pass the values. By default for S3 If you
don't specify this it defaults to Standard. So, in Ozone over S3 also, as we want to default
to Ratis and replication factor three by default.
> We can use the mapping Standard to RATIS and REDUCED_REDUNDANCY to Stand alone.
> There are 2 more values 
> STANDARD_IA and ONEZONE_IA these need to be considered later how we want to use them.
Intially we are considering to use Standard and Reduced_Redundancy.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message