hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Somogyi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-18108) Procedure WALs are archived but not cleaned; fix
Date Wed, 11 Oct 2017 16:47:00 GMT

     [ https://issues.apache.org/jira/browse/HBASE-18108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Peter Somogyi updated HBASE-18108:
----------------------------------
    Release Note: 
The archived Procedure WALs are moved to <hbase_root>/oldWALs/masterProcedureWALs
directory. TimeToLiveProcedureWALCleaner class was added which regularly cleans the Procedure
WAL files from there.

The TimeToLiveProcedureWALCleaner is added to hbase.master.logcleaner.plugins configuration
value.

A new config parameter is added: hbase.master.procedurewalcleaner.ttl, which specifies how
long a Procedure WAL should stay in the archive directory.

  was:
The archived Procedure WALs are moved to <hbase_root>/oldWALs/masterProcedureWALs
directory. TimeToLiveProcedureWALCleaner class was added which regularly cleans the Procedure
WAL files from there.
The TimeToLiveProcedureWALCleaner is added to hbase.master.logcleaner.plugins configuration
value.

A new config parameter is added: hbase.master.proclogcleaner.ttl, which specifies how long
a Procedure WAL should stay in the
archive directory.


> Procedure WALs are archived but not cleaned; fix
> ------------------------------------------------
>
>                 Key: HBASE-18108
>                 URL: https://issues.apache.org/jira/browse/HBASE-18108
>             Project: HBase
>          Issue Type: Sub-task
>          Components: proc-v2
>    Affects Versions: 2.0.0
>            Reporter: stack
>            Assignee: Peter Somogyi
>            Priority: Blocker
>             Fix For: 2.0.0
>
>         Attachments: HBASE-18108.master.001.patch, HBASE-18108.master.002.patch, HBASE-18108.master.003.patch,
HBASE-18108.master.004.patch, HBASE-18108.master.004.patch
>
>
> The Procedure WAL files used to be deleted when done. HBASE-14614 keeps them around in
case issue but what is missing is a GC for no-longer-needed WAL files. This one is pretty
important.
> From WALProcedureStore Cleaner TODO in https://docs.google.com/document/d/1eVKa7FHdeoJ1-9o8yZcOTAQbv0u0bblBlCCzVSIn69g/edit#heading=h.r2pc835nb7vi



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message