Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 34688 invoked from network); 18 Aug 2009 19:20:52 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 18 Aug 2009 19:20:52 -0000 Received: (qmail 47306 invoked by uid 500); 18 Aug 2009 19:21:11 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 47278 invoked by uid 500); 18 Aug 2009 19:21:11 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 47219 invoked by uid 99); 18 Aug 2009 19:21:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Aug 2009 19:21:05 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of saint.ack@gmail.com designates 209.85.221.188 as permitted sender) Received: from [209.85.221.188] (HELO mail-qy0-f188.google.com) (209.85.221.188) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Aug 2009 19:20:55 +0000 Received: by qyk26 with SMTP id 26so2956100qyk.5 for ; Tue, 18 Aug 2009 12:20:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to :content-type; bh=u2qAbYha6Qg5ygVKK9RVVJ33q06QGH/vk3G3e+TbGXY=; b=UzZZBnUGmDKKz8XZi+HdM3+cIWLG83WbmPU7wSb1vJOjHELUxNZ/3Pg+wsQqfGFYbJ IVDuHfrGxfijpAbYdngckEqya6L6gP+QCBOCnsn4cppDGnE8YBgpp+2nfKYWGD3gP2FD 6PGqHkmy/bO3g24kIZLpc8t3/kWygtfKsapXg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; b=lX3BWQ7r7YyzWgiBVUBu1wCpguJcaliIO8uIxuu4Q7WzNYiA5g8G2Naw6qJtoUlcOJ 37EcoRsFW1yGGizmlFSEztPYp5xjHwzzCDHDOv+1b1L08CfA+FFDFiuecplPYPw60QVw gm7y2nlSelX39NJeMQhJNgfOM0QkyPFzoFdag= MIME-Version: 1.0 Sender: saint.ack@gmail.com Received: by 10.229.19.72 with SMTP id z8mr2792719qca.35.1250623232662; Tue, 18 Aug 2009 12:20:32 -0700 (PDT) In-Reply-To: References: <7c962aed0908172252q5eab02fax7dfada4ee99dcb32@mail.gmail.com> <7c962aed0908181146q28a9a788la3fe8c3756fbe6c@mail.gmail.com> Date: Tue, 18 Aug 2009 12:20:32 -0700 X-Google-Sender-Auth: 035fe88b3af1fe22 Message-ID: <7c962aed0908181220j337476fag41d49cdb6193b30d@mail.gmail.com> Subject: Re: hbase 0.20.0 Release Candidate 2 available for download From: stack To: hbase-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=00163683265c87dc9304716f6940 X-Virus-Checked: Checked by ClamAV on apache.org --00163683265c87dc9304716f6940 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Thats a good one Billy. IMO, we can wait till 0.20.1 for a fix. St.Ack On Tue, Aug 18, 2009 at 12:12 PM, Billy Pearson wrote: > take a look at > HBASE-1777 > not sure but It might need to be addressed in 0.20.0 > > This cause my whole cluster to go down because each server reloads the bad > column from hlog replays and the next server goes down on the next memstore > flush for that region. > > Billy > > > > > "stack" wrote in message > news:7c962aed0908181146q28a9a788la3fe8c3756fbe6c@mail.gmail.com... > >> Please file a bug Billy. >> >> IMO this is not a critical issue since its easy enough making a >> workaround. >> >> Thanks, >> St.Ack >> >> On Tue, Aug 18, 2009 at 10:58 AM, Billy Pearson >> wrote: >> >> testing RC2 >>> >>> found >>> 2009-08-18 12:54:16,572 FATAL >>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog >>> required. Forcing server shutdown >>> org.apache.hadoop.hbase.DroppedSnapshotException: region: >>> webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062 >>> at >>> >>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950) >>> at >>> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843) >>> at >>> >>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241) >>> at >>> >>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149) >>> Caused by: java.io.IOException: Key length 183108 > 65536 >>> at >>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511) >>> at >>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479) >>> at >>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447) >>> at >>> >>> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525) >>> at >>> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489) >>> at >>> >>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935) >>> ... 3 more >>> >>> >>> looks like from a mr job we allow keys larger then 65536 to be processed >>> but when the memcache flush happends we kill the server should the client >>> not fail before the long key gets in to memory? >>> >>> Billy >>> >>> >>> >>> "stack" wrote in message >>> news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32@mail.gmail.com... >>> >>> The second hbase 0.20.0 release candidate is available for download: >>>> >>>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/ >>>> >>>> >>>> Near to 450 issues have been addressed since the 0.19 branch. Release >>>> notes >>>> are available here: http://su.pr/18zcEO . >>>> >>>> HBase 0.20.0 runs on Hadoop 0.20.0. Alot has changed since 0.19.x >>>> including >>>> configuration fundamentals. Be sure to read the 'Getting Started' >>>> documentation in 0.20.0 available here: http://su.pr/8YQjHO >>>> >>>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will >>>> need >>>> to run a migration. See >>>> http://wiki.apache.org/hadoop/Hbase/HowToMigrate >>>> . >>>> First read the overview and then go to the section, 'From 0.19.x to >>>> 0.20.x'. >>>> >>>> Should we release this candidate as hbase 0.20.0? Please vote +1/-1 by >>>> Wednesday, August 25th. >>>> >>>> Yours, >>>> The HBasistas >>>> >>>> >>>> >>> >>> >> > > --00163683265c87dc9304716f6940--