hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sterfield <sterfi...@gmail.com>
Subject Re: Hbase regionserver.MultiVersionConcurrencyControl Warning
Date Tue, 16 Aug 2016 13:12:10 GMT
> This is a well-known issue over in tsdb-land. IIRC, they are working on
> alternative to the once-an-hour compression. See what they say over there
> Guillaume.
> Thanks,
> St.Ack

Thanks for the tips. I'll check on OpenTSDB side and come back here with
what I'll find.

I have one last question : How could I handle the burst generated by the
OpenTSDB compaction ?

The OpenTSDB log has some line like :

12:04:56.586 ERROR [CompactionQueue.call] - Failed to write a row to
Above memstore limit, regionName=tsdb,\x00\x03\xD9W\
memstoreSize=1098822960, blockingMemStoreSize=1073741824

Indeed, the memstore limit was reached (256MB x 4), hence the error.
However, the fact that the Hbase was not able to flush the memstore is a
bit concerning.
On the corresponding RS, at the same time, there's a message about a big
flush, but not with so much memory in the memstore. Also, I don't see any
warning that could explain why the memstore grew so large (nothing about
the fact that there's too many hfiles to compact, for example)

2016-08-16 12:04:57,752 INFO  [MemStoreFlusher.0] regionserver.HRegion:
Finished memstore flush of ~821.25 MB/861146920, currentsize=226.67
MB/237676040 for region
in 13449ms, sequenceid=11332624, compaction requested=true

So, what could explain this amount of memory taken by the memstore, and how
I could handle such situation ?

Thanks for your help,


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message