hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zesheng Wu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types
Date Tue, 13 May 2014 05:34:17 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996072#comment-13996072

Zesheng Wu commented on HDFS-5682:

Thanks [~ndimiduk], here are some details of our SLA requirements:
The background is that we have a structured data storage system which is very similar with
amazon DynamoDB and is built on HBase. This system is intended to serve multi-tenants, in
order to ensure the SLA, such as 99% read/write latency, we need to place the data on SSD.
One straightforward way is to set up a hdfs cluster with all SSD data disks, but this is cost
too much. So we need to reduce the cost. Another way is to set up a hdfs cluster with both
SSD and HDD data disks, we can put 1 replica on SSD, and the other 2 on HDD. This is really
a typical scenario of hdfs heterogeneous storage.

> Heterogeneous Storage phase 2 - APIs to expose Storage Types
> ------------------------------------------------------------
>                 Key: HDFS-5682
>                 URL: https://issues.apache.org/jira/browse/HDFS-5682
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 3.0.0
>            Reporter: Arpit Agarwal
>            Assignee: Arpit Agarwal
> Phase 1 (HDFS-2832) added support to present the DataNode as a collection of discrete
storages of different types.
> This Jira is to track phase 2 of the Heterogeneous Storage work which involves exposing
Storage Types to applications and adding Quota Management support for administrators.
> This phase will also include tools support for administrators/users.

This message was sent by Atlassian JIRA

View raw message