hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cosmin Lehene <cleh...@adobe.com>
Subject Re: HBase 0.90.4 missing data in production
Date Mon, 07 Nov 2011 17:07:06 GMT
Dropping in. 
Vladimir, can you check if there's any time skew between servers? (I can't
remember the exact details, but once we ended up with .META. region
location (cells) that were dated in the future because time was skewed on
some machine - so regions were not visible for a few hours)

Also, if you're willing to dig deeper, you could try loading individual
HFiles and counting the rows directly.


On 11/5/11 12:13 AM, "Stack" <stack@duboce.net> wrote:

>On Fri, Nov 4, 2011 at 2:47 PM, Vladimir Rodionov
><vrodionov@carrieriq.com> wrote:
>> There are no ERRORs and FATALs in Region Servers logs except one FATAL
>>I have already posted. HLog sync
>> I am asking expert advise: what else should I check?
>8 rows out of 10k?
>Can you find what the 8 are?  Can you go do the src data to figure
>which?  Can you see anything in particular regards this 8 rows and
>say, those around them?  Once you have the 8 rows, can you see where
>they were inserted?  Can you figure time of insertion?  Can you see if
>anything happened to the data at that time?   Can you look in the
>regions?  Look at the hfiles under the region.  Use the tool here:
>http://hbase.apache.org/book.html#hfile_tool.  See if the rows are in

View raw message