hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Enis Soztutar (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HBASE-15973) PeriodicMemstoreFlusher is causing excessive flushes when back-in-time inserts are happening
Date Wed, 08 Jun 2016 23:17:21 GMT

     [ https://issues.apache.org/jira/browse/HBASE-15973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Enis Soztutar resolved HBASE-15973.
-----------------------------------
    Resolution: Not A Problem

I've checked the code again, we are doing the correct thing: 
{code}
  private void setOldestEditTimeToNow() {
    if (timeOfOldestEdit == Long.MAX_VALUE) {
      timeOfOldestEdit = EnvironmentEdgeManager.currentTime();
    }
  }
{code}

I don't have the logs saved, so closing this for now, since I am not sure whether there were
any other issues or not. 

> PeriodicMemstoreFlusher is causing excessive flushes when back-in-time inserts are happening
> --------------------------------------------------------------------------------------------
>
>                 Key: HBASE-15973
>                 URL: https://issues.apache.org/jira/browse/HBASE-15973
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Enis Soztutar
>             Fix For: 2.0.0, 1.3.0, 1.4.0
>
>
> In a production cluster, we have noticed a case where flushes were happening for 200-400KB
in sizes. Turns out the periodic memstore flusher is force flushing because cells with older
timestamps (in this case days old) were being inserted. 
> We have periodic memstore flusher with 1 hour defaulted, so in a case where replication
is lagging, or phoenix secondary index rebuild or the user doing back-in-time inserts with
cell timestamps older than 1 hour, we will flush extremely frequently. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message