hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sunweiwei" <su...@asiainfo-linkage.com>
Subject forcing flush not works
Date Tue, 03 Jun 2014 07:43:49 GMT
Hi

 

I'm using a heavy-write hbase0.96 . I find this in regionserver log:  

2014-06-03 15:13:19,445 INFO  [regionserver60020.logRoller] wal.FSHLog: Too
many hlogs: logs=33, maxlogs=32; forcing flush of 3 regions(s):
1a7dda3c3815c19970ace39fd99abfe8, aff81bc46aa7d3ed51a01f11f23c8320,
d5666e003f598147b4dda509f173a779

2014-06-03 15:13:23,869 INFO  [regionserver60020.logRoller] wal.FSHLog: Too
many hlogs: logs=34, maxlogs=32; forcing flush of 2 regions(s):
aff81bc46aa7d3ed51a01f11f23c8320, d5666e003f598147b4dda509f173a779

┇

┇

2014-06-03 15:18:14,778 INFO  [regionserver60020.logRoller] wal.FSHLog: Too
many hlogs: logs=93, maxlogs=32; forcing flush of 2 regions(s):
aff81bc46aa7d3ed51a01f11f23c8320, d5666e003f598147b4dda509f173a779

 

 

It seems like 2 regions can’t be flushed and WALs Dir continue to increase
and Then I find this in client log:

INFO | AsyncProcess-waitForMaximumCurrentTasks [2014-06-03 15:30:53] - :
Waiting for the global number of running tasks to be equals or less than 0,
tasksSent=15819, tasksDone=15818, currentTasksDone=15818,
tableName=BT_D_BF001_201406

 

Then write speed will become very slow. 

After I flush 2 regions  manually , write speed can back to normal  only   a
short while.

 

Any suggestion will be appreciated. Thanks.


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message