hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aiyoh79 <tcheng...@gmail.com>
Subject Re: Hbase Compression
Date Wed, 25 Sep 2013 01:41:25 GMT
Hi J-D

I am doing some benchmark using ycsb and the log entries retrieved were
during the data loading stage. So i don't think there is and data deleted
and also overwriting.

Aiyoh79


Jean-Daniel Cryans wrote
> On flushing we do some cleanup, like removing deleted data that was
> already
> in the MemStore or extra versions. Could it be that you are overwriting
> recently written data?
> 
> 48MB is the size of the Memstore that accumulated while the flushing
> happened.
> 
> J-D
> 
> 
> On Tue, Sep 24, 2013 at 3:50 AM, aiyoh79 &lt;

> tchengwee@

> &gt; wrote:
> 
>> Hi,
>>
>> I am using hbase 0.94.11 and i feel a bit confuse when looking at the log
>> file below:
>>
>> 13/09/24 13:11:00 INFO regionserver.Store: Flushed , sequenceid=687077,
>> memsize=
>> 122.1m, into tmp file
>> hdfs://192.168.123.123:54310/hbase/usertable/b19289cf9b1400
>> c6daddc347337bac03/.tmp/13f0d91efe784372a796585a6c1e05d3
>> 13/09/24 13:11:00 INFO regionserver.Store: Added
>> hdfs://192.168.123.123:54310/hba
>>
>> se/usertable/b19289cf9b1400c6daddc347337bac03/family/13f0d91efe784372a796585a6c1
>> e05d3, entries=432620, sequenceid=687077, filesize=64.4m
>> 13/09/24 13:11:00 INFO regionserver.HRegion: Finished memstore flush of
>> ~128.2m/
>> 134402240, currentsize=48.0m/50366240 for region
>> usertable,user4\xB4\xB0,1379998
>> 895119.b19289cf9b1400c6daddc347337bac03. in 1163ms, sequenceid=687077,
>> compactio
>> n requested=false
>>
>> It seems like it will first flush into a tmp file and the memsize is
>> 122.1m,
>> but when it finally added, the size is 64.4m. Lastly, there are 2 more
>> parameters which is 128.2m and 48.0m for currentsize.
>>
>> I never specify hbase.regionserver.codecs preperty in my hbase-site.xml
>> file, so is the size difference still because of compression?
>>
>> Thanks,
>>
>> aiyoh79
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-hbase.679495.n3.nabble.com/Hbase-Compression-tp4051122.html
>> Sent from the HBase User mailing list archive at Nabble.com.
>>





--
View this message in context: http://apache-hbase.679495.n3.nabble.com/Hbase-Compression-tp4051122p4051187.html
Sent from the HBase User mailing list archive at Nabble.com.

Mime
View raw message