hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11863) WAL files are not archived and stays in the WAL directory after splitting
Date Wed, 03 Sep 2014 06:29:52 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119444#comment-14119444
] 

Hudson commented on HBASE-11863:
--------------------------------

FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #465 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/465/])
HBASE-11863 WAL files are not archived and stays in the WAL directory after splitting (enis:
rev 7f28fcf429242c549219502bfb7da0ad28753f4c)
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/SplitLogManager.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestSplitLogManager.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java


> WAL files are not archived and stays in the WAL directory after splitting 
> --------------------------------------------------------------------------
>
>                 Key: HBASE-11863
>                 URL: https://issues.apache.org/jira/browse/HBASE-11863
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Enis Soztutar
>            Assignee: Enis Soztutar
>            Priority: Blocker
>             Fix For: 0.99.0, 2.0.0, 0.98.6
>
>         Attachments: hbase-11863_v1-0.98.patch, hbase-11863_v1.patch, hbase-11863_v2.patch,
hbase-11863_v3-0.98.patch, hbase-11863_v3-0.99.patch, hbase-11863_v3.patch
>
>
> In patch HBASE-11094, it seems that we changed the constructor we are using for SplitLogManager,
which does not archive the log files after splitting is done to the archive folder. The log
files stays in the splitting directory forever and re-split every time the master restarts.

> It is surprising that our unit tests are passing (since 0.94.4) without any issues. Part
of the reason is that the split is actually carried, but the WAL is not moved and thus the
-splitting directory never gets deleted. 
> It seems critical to fix in 0.98.6, [~andrew.purtell@gmail.com] FYI. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message