hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jeff saremi <jeffsar...@hotmail.com>
Subject Re: Need guidance on Custom Compaction Policy
Date Wed, 22 Mar 2017 21:39:09 GMT
@Ted
No i had not looked at DateTiered. I will. Thanks

@Vladimir
I will look at the example code you gave me. thanks






________________________________
From: Ted Yu <yuzhihong@gmail.com>
Sent: Wednesday, March 22, 2017 2:12:00 PM
To: user@hbase.apache.org
Subject: Re: Need guidance on Custom Compaction Policy

Have you taken look at http://hbase.apache.org/book.html#ops.date.tiered ?

Cheers

On Wed, Mar 22, 2017 at 12:29 PM, jeff saremi <jeffsaremi@hotmail.com>
wrote:

> I mentioned some of this in another thread. We have a readonly database
> which get bulk loaded using HFiles.
> We want to keep only two versions/generations of data. Since the size of
> data is massive we need to delete the older generation.
>
> Since we write one single HBase for each region for each CF for each
> generation, could we just yank the older files using a separate standalone
> process? (sounds a little scary)
>
> If not, could we write a custom compactor? what's involved (some pointers
> please)? thanks
>
> Jeff
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message