hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12848) Utilize Flash storage for WAL
Date Mon, 06 Jul 2015 12:48:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614983#comment-14614983
] 

Anoop Sam John commented on HBASE-12848:
----------------------------------------

We will be doing the archiving of the WAL files later.  Ideally no need to keep the archived
WALs in flash storage. That will be wastage of the resource. The archive op is done by file
rename.  Had some discussion with [~tedyu] and [~jingcheng.du@intel.com]. HDFS wont move the
file content across different block volumes on rename.  The Mover tool only can do this which
has to be invoked explicitly.   We have to solve this some way?  Later on if we try to place
some HFiles also (depending on some stats) to SSDs, this might become more critical.

> Utilize Flash storage for WAL
> -----------------------------
>
>                 Key: HBASE-12848
>                 URL: https://issues.apache.org/jira/browse/HBASE-12848
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>             Fix For: 2.0.0, 1.1.0
>
>         Attachments: 12848-v1.patch, 12848-v2.patch, 12848-v3.patch, 12848-v4.patch,
12848-v4.patch
>
>
> One way to improve data ingestion rate is to make use of Flash storage.
> HDFS is doing the heavy lifting - see HDFS-7228.
> We assume an environment where:
> 1. Some servers have a mix of flash, e.g. 2 flash drives and 4 traditional drives.
> 2. Some servers have all traditional storage.
> 3. RegionServers are deployed on both profiles within one HBase cluster.
> This JIRA allows WAL to be managed on flash in a mixed-profile environment.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message