hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lars hofhansl <la...@apache.org>
Subject Re: Re: Why can the capacity of a table with TTL grow continuously?
Date Tue, 10 Mar 2015 23:21:31 GMT
I agree. This looks as it should.You also mentioned that you have compactions enabled.
If you force a major_compact through the HBase shell, will some space be reclaimed? (careful,
this will compact everything in the table, which can put some load on the net/disks).Lastly,
did you stop collecting new data? Are you sure you're not just collecting more data? (just
asking :) )
To verify whether old data is still there or not, you can also run a raw scan. Something like
this from the shell:
scan <table>, {RAW => true, VERSIONS => 10000, TIMERANGE => [0, 1408749519438]}
(1408749519438 is about 200 days ago from right now)
If that query returns anything, then we'd have a problem.
-- Lars

      From: Jean-Marc Spaggiari <jean-marc@spaggiari.org>
 To: user <user@hbase.apache.org> 
 Sent: Monday, March 9, 2015 9:08 PM
 Subject: Re: Re: Why can the capacity of a table with TTL grow continuously?
   
Ok, nothing wrong there.

Have you disabled the daily (or weekly) major compactions on your cluster?
Wich HBase version are you running?

JM



2015-03-09 23:53 GMT-04:00 David chen <c77_cn@163.com>:

> Thanks jean-marc, the table description is as following:
> 'tab_normal', {NAME => 'f1', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER =>
> 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'SNAPPY', VERSIONS =>
> '10000', TTL => '16070400 SECONDS (186 DAYS)', MIN_VERSIONS => '0',
> KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false',
> BLOCKCACHE => 'true'}, {NAME => 'f2', DATA_BLOCK_ENCODING => 'NONE',
> BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'SNAPPY',
> VERSIONS => '10000', TTL => '16070400 SECONDS (186 DAYS)', MIN_VERSIONS =>
> '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY =>
> 'false', BLOCKCACHE => 'true'}, {NAME => 'idx', DATA_BLOCK_ENCODING =>
> 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION =>
> 'SNAPPY', VERSIONS => '10000', TTL => '16070400 SECONDS (186 DAYS)',
> MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536',
> IN_MEMORY => 'false', BLOCKCACHE => 'true'}


   
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message