phoenix-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jaanai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-5250) The accumulated wal files can't be cleaned
Date Thu, 02 May 2019 23:59:00 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16832107#comment-16832107
] 

jaanai commented on PHOENIX-5250:
---------------------------------

Yes, the faked waledites and normal waledites get put into the memstore together with an InMemsotre
identifier. All cells of the edits will be recalculated before changing -HBASE-20781- , and
the faked waledits will be filtered, but it will directly use all cells of the edits if families are
not null all after changing.

 

> The accumulated wal files can't be cleaned
> ------------------------------------------
>
>                 Key: PHOENIX-5250
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-5250
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: jaanai
>            Priority: Blocker
>             Fix For: 5.1.0
>
>         Attachments: image-2019-04-19-21-31-27-888.png
>
>
> Because of the modification of HBASE-20781,  the faked WALEdits won't be filtered,
all WALEdits will be saved into Memstore with a status that inMemstore is true(uses WAL->append
method).
> !image-2019-04-19-21-31-27-888.png|width=755,height=310!
> The family array of IndexedKeyValue is WALEdit.METAFAMILY that is used to describe
a fake WALEdit, and it will put into Memstore with WALedits of data table during sync global
index.
> WAL files can't be cleaned, except for restarting RS, Many WAL files will decrease the
percent of disk free.  
> !https://gw.alicdn.com/tfscom/TB1n3cDQVzqK1RjSZFCXXbbxVXa.png|width=422,height=159!
>  
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message