hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Billy Pearson" <sa...@pearsonwholesale.com>
Subject Re: hbase 0.20.0 Release Candidate 2 available for download
Date Tue, 18 Aug 2009 19:12:01 GMT
take a look at
HBASE-1777
not sure but It might need to be addressed in 0.20.0

This cause my whole cluster to go down because each server reloads the bad 
column from hlog replays and the next server goes down on the next memstore 
flush for that region.

Billy




"stack" <stack@duboce.net> wrote in message 
news:7c962aed0908181146q28a9a788la3fe8c3756fbe6c@mail.gmail.com...
> Please file a bug Billy.
>
> IMO this is not a critical issue since its easy enough making a 
> workaround.
>
> Thanks,
> St.Ack
>
> On Tue, Aug 18, 2009 at 10:58 AM, Billy Pearson
> <sales@pearsonwholesale.com>wrote:
>
>> testing RC2
>>
>> found
>> 2009-08-18 12:54:16,572 FATAL
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog
>> required. Forcing server shutdown
>> org.apache.hadoop.hbase.DroppedSnapshotException: region:
>> webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950)
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843)
>>       at
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241)
>>       at
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149)
>> Caused by: java.io.IOException: Key length 183108 > 65536
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511)
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479)
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
>>       at
>> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525)
>>       at
>> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489)
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935)
>>       ... 3 more
>>
>>
>> looks like from a mr job we allow keys larger then 65536 to be processed
>> but when the memcache flush happends we kill the server should the client
>> not fail before the long key gets in to memory?
>>
>> Billy
>>
>>
>>
>> "stack" <stack@duboce.net> wrote in message
>> news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32@mail.gmail.com...
>>
>>> The second hbase 0.20.0 release candidate is available for download:
>>>
>>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
>>>
>>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>>> notes
>>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>>
>>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>>> including
>>> configuration fundamentals.  Be sure to read the 'Getting Started'
>>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>>
>>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>>> need
>>> to run a migration.  See 
>>> http://wiki.apache.org/hadoop/Hbase/HowToMigrate
>>> .
>>> First read the overview and then go to the section, 'From 0.19.x to
>>> 0.20.x'.
>>>
>>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>>> Wednesday, August 25th.
>>>
>>> Yours,
>>> The HBasistas
>>>
>>>
>>
>>
> 



Mime
View raw message