hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2087) The wait on compaction because "Too many store files" holds up all flushing
Date Mon, 04 Jan 2010 18:11:54 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796271#action_12796271
] 

stack commented on HBASE-2087:
------------------------------

The problem this issue covers is case where a regionserver has say 1k regions and it so happens
that one of these is over the store file upper limit.  As is all flushing on the regionserver
is held up because one region is over the limit.   Because no flushing we will block writes
and so on

> The wait on compaction because "Too many store files" holds up all flushing
> ---------------------------------------------------------------------------
>
>                 Key: HBASE-2087
>                 URL: https://issues.apache.org/jira/browse/HBASE-2087
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>
> The method MemStoreFlusher#checkStoreFileCount is called from flushRegion.  flushRegion
is called by MemStoreFlusher#run thread.  If the checkStoreFileCount finds too many store
files, it'll stick around waiting on a compaction to happen.  While its hanging, the MemStoreFlusher#run
is held up.  No other region can flush.  Meantime WALs will be rolling and memory will be
accumulating writes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message