hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zach York (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17437) Support specifying a WAL directory outside of the root directory
Date Tue, 10 Jan 2017 17:54:58 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815656#comment-15815656

Zach York commented on HBASE-17437:

Why is having the WAL root dir as a sub directory of the root dir an issue? I agree that we
might want to guard against some places. In that case, maybe it is easier to just ensure that
it is a separate directory if set. I don't think we want to change the defaults (to move it
out of the root dir by default).

What is your suggestion for naming of the config?

> Support specifying a WAL directory outside of the root directory
> ----------------------------------------------------------------
>                 Key: HBASE-17437
>                 URL: https://issues.apache.org/jira/browse/HBASE-17437
>             Project: HBase
>          Issue Type: Improvement
>          Components: Filesystem Integration, wal
>    Affects Versions: 1.2.4
>            Reporter: Yishan Yang
>            Assignee: Yishan Yang
>              Labels: patch
>             Fix For: 2.0.0, 1.4.0
>         Attachments: hbase-17437-branch-1.2.patch, hbase-17437-master.patch
> Currently, the WAL and the StoreFiles need to be on the same FileSystem. Some FileSystems
(such as Amazon S3) don’t support append or consistent writes. These two properties are
imperative for the WAL in order to avoid loss of writes. However, StoreFiles don’t necessarily
need the same consistency guarantees (since writes are cached locally and if writes fail,
they can always be replayed from the WAL).
> This JIRA aims to allow users to configure a log directory (for WALs) that is outside
of the root directory or even in a different FileSystem. The default value will still put
the log directory under the root directory.

This message was sent by Atlassian JIRA

View raw message