hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Enis Soztutar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17437) Support specifying a WAL directory outside of the root directory
Date Wed, 08 Feb 2017 19:02:42 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858403#comment-15858403
] 

Enis Soztutar commented on HBASE-17437:
---------------------------------------

bq. Enis Soztutar For the first point, It looks like we might want to do this in the master
patch. I can open a JIRA for that later today.
Please do, and link it here. I would like to keep the master and branch-1 patches as close
as possible. History tracking gets hard otherwise. In the branch-1 commit, we should mention
that the other jiras are incorporated. 

bq. For the second point, the only place this is currently used is getFailedServersFromLogFolders
which only pays attention to WALs. I see that this method is public instead of private, is
there a plan to use it outside of MasterFileSystem
Seems that HBASE-15763 only went in 2.0 which changes this. We do not have to make changes
to this method in branch-1, we can just get rid of fsOk, and keep walFsOk. 

> Support specifying a WAL directory outside of the root directory
> ----------------------------------------------------------------
>
>                 Key: HBASE-17437
>                 URL: https://issues.apache.org/jira/browse/HBASE-17437
>             Project: HBase
>          Issue Type: Improvement
>          Components: Filesystem Integration, wal
>    Affects Versions: 1.2.4
>            Reporter: Yishan Yang
>            Assignee: Zach York
>              Labels: patch
>             Fix For: 2.0.0, 1.4.0
>
>         Attachments: HBASE-17437.branch-1.001.patch, HBASE-17437.branch-1.002.patch,
HBASE-17437.branch-1.003.patch, HBASE-17437.branch-1.004.patch, hbase-17437-branch-1.2.patch,
HBASE-17437.master.001.patch, HBASE-17437.master.002.patch, HBASE-17437.master.003.patch,
HBASE-17437.master.004.patch, HBASE-17437.master.005.patch, HBASE-17437.master.006.patch,
HBASE-17437.master.007.patch, HBASE-17437.master.008.patch, HBASE-17437.master.009.patch,
HBASE-17437.master.010.patch, HBASE-17437.master.011.patch, HBASE-17437.master.012.patch,
hbase-17437-master.patch
>
>
> Currently, the WAL and the StoreFiles need to be on the same FileSystem. Some FileSystems
(such as Amazon S3) don’t support append or consistent writes. These two properties are
imperative for the WAL in order to avoid loss of writes. However, StoreFiles don’t necessarily
need the same consistency guarantees (since writes are cached locally and if writes fail,
they can always be replayed from the WAL).
>  
> This JIRA aims to allow users to configure a log directory (for WALs) that is outside
of the root directory or even in a different FileSystem. The default value will still put
the log directory under the root directory.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message