Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BF77F18360 for ; Mon, 6 Jul 2015 12:48:05 +0000 (UTC) Received: (qmail 86259 invoked by uid 500); 6 Jul 2015 12:48:05 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 86210 invoked by uid 500); 6 Jul 2015 12:48:05 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 86196 invoked by uid 99); 6 Jul 2015 12:48:05 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Jul 2015 12:48:05 +0000 Date: Mon, 6 Jul 2015 12:48:05 +0000 (UTC) From: "Anoop Sam John (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-12848) Utilize Flash storage for WAL MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614983#comment-14614983 ] Anoop Sam John commented on HBASE-12848: ---------------------------------------- We will be doing the archiving of the WAL files later. Ideally no need to keep the archived WALs in flash storage. That will be wastage of the resource. The archive op is done by file rename. Had some discussion with [~tedyu] and [~jingcheng.du@intel.com]. HDFS wont move the file content across different block volumes on rename. The Mover tool only can do this which has to be invoked explicitly. We have to solve this some way? Later on if we try to place some HFiles also (depending on some stats) to SSDs, this might become more critical. > Utilize Flash storage for WAL > ----------------------------- > > Key: HBASE-12848 > URL: https://issues.apache.org/jira/browse/HBASE-12848 > Project: HBase > Issue Type: Sub-task > Reporter: Ted Yu > Assignee: Ted Yu > Fix For: 2.0.0, 1.1.0 > > Attachments: 12848-v1.patch, 12848-v2.patch, 12848-v3.patch, 12848-v4.patch, 12848-v4.patch > > > One way to improve data ingestion rate is to make use of Flash storage. > HDFS is doing the heavy lifting - see HDFS-7228. > We assume an environment where: > 1. Some servers have a mix of flash, e.g. 2 flash drives and 4 traditional drives. > 2. Some servers have all traditional storage. > 3. RegionServers are deployed on both profiles within one HBase cluster. > This JIRA allows WAL to be managed on flash in a mixed-profile environment. -- This message was sent by Atlassian JIRA (v6.3.4#6332)