hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Billy Pearson" <billy_pear...@sbcglobal.net>
Subject Re: hbase 0.20.0 Release Candidate 2 available for download
Date Tue, 18 Aug 2009 18:57:46 GMT


Will file in 0.20.1 once I finish debugging the problem looks like its the 
column not the key causing the problem

Billy

----- Original Message ----- 
From: "stack" <stack-+c050i++PmesTnJN9+BGXg@public.gmane.org>
Newsgroups: 
gmane.comp.java.hadoop.hbase.devel,gmane.comp.java.hadoop.hbase.user
To: <hbase-dev-7ArZoLwFLBtd/SJB6HiN2Ni2O/JbrIOy@public.gmane.org>
Cc: <hbase-user-7ArZoLwFLBtd/SJB6HiN2Ni2O/JbrIOy@public.gmane.org>
Sent: Tuesday, August 18, 2009 1:46 PM
Subject: Re: hbase 0.20.0 Release Candidate 2 available for download


> Please file a bug Billy.
>
> IMO this is not a critical issue since its easy enough making a 
> workaround.
>
> Thanks,
> St.Ack
>
> On Tue, Aug 18, 2009 at 10:58 AM, Billy Pearson
> <sales-bilS+b3c8gufP+p43NWRKVaTQe2KTcn/@public.gmane.org>wrote:
>
>> testing RC2
>>
>> found
>> 2009-08-18 12:54:16,572 FATAL
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog
>> required. Forcing server shutdown
>> org.apache.hadoop.hbase.DroppedSnapshotException: region:
>> webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950)
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843)
>>       at
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241)
>>       at
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149)
>> Caused by: java.io.IOException: Key length 183108 > 65536
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511)
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479)
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
>>       at
>> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525)
>>       at
>> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489)
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935)
>>       ... 3 more
>>
>>
>> looks like from a mr job we allow keys larger then 65536 to be processed
>> but when the memcache flush happends we kill the server should the client
>> not fail before the long key gets in to memory?
>>
>> Billy
>>
>>
>>
>> "stack" <stack-+c050i++PmesTnJN9+BGXg@public.gmane.org> wrote in message
>> news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32-JsoAwUIsXouq+1Nelnf3ueG/Ez6ZCGd0@public.gmane.org
>>
>>> The second hbase 0.20.0 release candidate is available for download:
>>>
>>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
>>>
>>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>>> notes
>>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>>
>>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>>> including
>>> configuration fundamentals.  Be sure to read the 'Getting Started'
>>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>>
>>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>>> need
>>> to run a migration.  See 
>>> http://wiki.apache.org/hadoop/Hbase/HowToMigrate
>>> .
>>> First read the overview and then go to the section, 'From 0.19.x to
>>> 0.20.x'.
>>>
>>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>>> Wednesday, August 25th.
>>>
>>> Yours,
>>> The HBasistas
>>>
>>>
>>
>>
> 



Mime
View raw message