hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andy Sautins <andy.saut...@returnpath.net>
Subject RE: major compaction and regionserver failure...
Date Sat, 10 Dec 2011 22:25:58 GMT


  Thanks for the response.  So to summarize compaction requests in the compaction queue of
the failed regionserver are lost and not picked up when the regions are picked up by another
regionserver.  So if we lose a regionserver during a major compaction the regions that had
not yet been major compacted on the failed regionserver will not be major compacted as part
of that major compaction request, correct?

  Thanks for the insight.


-----Original Message-----
From: Mikhail Bautin [mailto:bautin.mailing.lists@gmail.com] 
Sent: Saturday, December 10, 2011 1:50 PM
To: user@hbase.apache.org
Subject: Re: major compaction and regionserver failure...

Hi Andy,

Compaction queues are not persisted between regionserver restarts, and the results of an incomplete
compaction are discarded. Compactions write into an HFile in a temporary location and only
move it to the region/CF directory in case of success (at least, this is how it works in trunk).


On Saturday, December 10, 2011, Andy Sautins wrote:

>   I was wondering if someone could tell me what happens if a 
> regionserver fails during major compaction.  Are the entries that were 
> in the compaction queue for the failed regionserver migrated along 
> with the regions to another server or are those requests for major 
> compaction effectively lost for that run of major compaction?  I guess 
> what I'm really asking is do I still get a full major compaction of 
> all regions or do I lose the major compactions of the regions that 
> were in the queue on the failed regionserver.
>   Any insight would be much appreciated.   We are currently running HBase
> 0.90.3-cdh3u1.

View raw message