hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Duo Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-18019) Clear redundant memstore scanners
Date Wed, 17 May 2017 05:46:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013562#comment-16013562
] 

Duo Zhang commented on HBASE-18019:
-----------------------------------

{quote}
We will be creating new memstore scanner (after the flush) and that is been added. Ideally
only the snapshot scanner should get cleared but to do that we will need larger change. We
discussed abt this in 17887
{quote}

Got it. No question then. +1.

> Clear redundant memstore scanners
> ---------------------------------
>
>                 Key: HBASE-18019
>                 URL: https://issues.apache.org/jira/browse/HBASE-18019
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 2.0.0
>            Reporter: Chia-Ping Tsai
>            Assignee: Chia-Ping Tsai
>             Fix For: 2.0.0
>
>         Attachments: HBASE-18019.v0.patch
>
>
> The HBASE-17655 remove the MemStoreScanner and it causes that the MemStore#getScanner(readpt)
returns multi KeyValueScanner which consist of active, snapshot and pipeline. But StoreScanner
only remove one mem scanner when refreshing current scanners.
> {code}
>     for (int i = 0; i < currentScanners.size(); i++) {
>       if (!currentScanners.get(i).isFileScanner()) {
>         currentScanners.remove(i);
>         break;
>       }
>     }
> {code}
> The older scanners kept in the StoreScanner will hinder GC from releasing memory and
lead to multiple scans on the same data.
>  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message