hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Rodionov <vladrodio...@gmail.com>
Subject Re: deleting row for aging purpose
Date Sat, 12 Mar 2016 22:46:46 GMT
>> Is that crazy idea?

kind of :)

Why do not use  cell's timestamps and column family TTL for that purpose?
Set explicitly KV's timestamp for every data point  you insert to be equals
to a data point's timestamp.
Your data will be automatically purged during compaction on TTL expiration.

-Vlad

On Sat, Mar 12, 2016 at 2:32 PM, Eric Owhadi <eric.owhadi@esgyn.com> wrote:

> Hello Hbaseers,
>
> When dealing with time series, one can imagine that deleting row older than
> a specific date threashold would be a common use case.
>
> If I am not mistaken, the only options available today to perform this
> aging delete is to first mark these row with a delete operation that will
> set tombstone marker, and then major compaction will take care of removing
> the data.
>
> However this tombstoning is consuming valuable resource and  I was
> wondering if we could instead pass a parameter to the major compact command
> and tell it, BTW, any rowkey lower than xxxxxxxx, consider it tomb stoned,
> so delete it.
>
> Is that crazy idea?
>
> Regards,
>
> Eric
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message