hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dave Latham <lat...@davelink.net>
Subject Re: All memstores flushed to be quite small files
Date Mon, 27 Mar 2017 14:47:16 GMT
Do you have compression enabled, and is your data highly compressible?

On Mon, Mar 27, 2017 at 6:26 AM, Hef <hef.online@gmail.com> wrote:

> Hi,
> Does anyone have an idea why most of my 128MB memstore flushed files are
> only several MBs?
>
> There are a lot of logs look as below:
>
> 2017-03-27 13:10:25,064 INFO
> org.apache.hadoop.hbase.regionserver.DefaultStoreFlusher: Flushed,
> sequenceid=13042496, memsize=128.0 M, hasBloomFilter=true, into tmp file
> hdfs://xxxxx
> 2017-03-27 13:10:25,093 INFO org.apache.hadoop.hbase.regionserver.HStore:
> Added
> hdfs://nameservice1/hbase/data/default/mytable/
> 82f4e7d6931a57edf9654f32625f9fb7/t/0f59c07ef24644a38dce577d7fb6ac1b,
> entries=545226, sequenceid=13042496, filesize=7.3 M
> 2017-03-27 13:10:25,094 INFO org.apache.hadoop.hbase.regionserver.HRegion:
> Finished memstore flush of ~128.02 MB/134235405, currentsize=352.34
> KB/360800 for region
> mytable,3808555269964B038A7BC1EC6CC19B03\x00\x00\x00\x00\x00\x00\
> x00\xA7\x00\x06P\xC9])\x9A\xC9\x01\xA9Q<\xBDX\x88\x07\
> x82\xEAR\xD7,1490340797381.82f4e7d6931a57edf9654f32625f9fb7.
> in 1052ms, sequenceid=13042496, compaction requested=false
>
> A 128MB memstore flushed to be only 7.3MB hfile, is that normal?
> In what case  could this happen?
>
> Thanks
> Hef
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message