Return-Path: Delivered-To: apmail-hadoop-hbase-user-archive@minotaur.apache.org Received: (qmail 55488 invoked from network); 30 Oct 2009 23:50:49 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 30 Oct 2009 23:50:49 -0000 Received: (qmail 99966 invoked by uid 500); 30 Oct 2009 23:50:49 -0000 Delivered-To: apmail-hadoop-hbase-user-archive@hadoop.apache.org Received: (qmail 99890 invoked by uid 500); 30 Oct 2009 23:50:49 -0000 Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-user@hadoop.apache.org Delivered-To: mailing list hbase-user@hadoop.apache.org Received: (qmail 99879 invoked by uid 99); 30 Oct 2009 23:50:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Oct 2009 23:50:49 +0000 X-ASF-Spam-Status: No, hits=-2.6 required=5.0 tests=AWL,BAYES_00 X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 209.85.216.198 is neither permitted nor denied by domain of sujee@sujee.net) Received: from [209.85.216.198] (HELO mail-px0-f198.google.com) (209.85.216.198) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Oct 2009 23:50:44 +0000 Received: by pxi36 with SMTP id 36so856076pxi.2 for ; Fri, 30 Oct 2009 16:50:24 -0700 (PDT) MIME-Version: 1.0 Received: by 10.142.55.11 with SMTP id d11mr216666wfa.17.1256946624085; Fri, 30 Oct 2009 16:50:24 -0700 (PDT) In-Reply-To: <31a243e70910291557l4106a8ack5fdd844764a1a0ce@mail.gmail.com> References: <31a243e70910290932w572439c3w6e23b881e3a55232@mail.gmail.com> <31a243e70910291101j649f3885rc9043a622a89ad89@mail.gmail.com> <31a243e70910291557l4106a8ack5fdd844764a1a0ce@mail.gmail.com> From: Sujee Maniyam Date: Fri, 30 Oct 2009 16:50:04 -0700 Message-ID: Subject: Re: long pauses during hbase.PerformanceEvaluation tests To: hbase-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable following up on this; hopefully this can help out some one else. turned out the culprit was 'ulimit -n'. it was the default 1024. I upped it to 32k. And that was like flicking a switch and making every thing work great! :-) now the benchmark-tests look much, much better. regards Sujee On Thu, Oct 29, 2009 at 3:57 PM, Jean-Daniel Cryans w= rote: > Sujee, > > Sorry the mailing list often doesn't ship the attached files so I > couldn't see it. > > So your log tells me that your split really took 14 mins... !!! Could > you re-run that with DEBUG? See > http://wiki.apache.org/hadoop/Hbase/FAQ#A5 > > Thx! > > J-D > > On Thu, Oct 29, 2009 at 3:23 PM, Sujee Maniyam wrote: >> http://pastebin.com/f37d75e1d >> This is what I previously sent out in the email as well. >> >> I don't have the logs anymore (shoulda saved them!). >> >> I also realized that my =A0'ulimit -n =3D 1024'. =A0 Going to up this to= 32k >> and re-run the test. =A0Will post the results. >> >> Any thing else, I should keep an eye out for? >> >> thanks >> Sujee >> >> On Thu, Oct 29, 2009 at 11:01 AM, Jean-Daniel Cryans >> wrote: >>> Yes, anything there? Care to paste some lines in a pastebin? >>> >>> Thx, >>> >>> J-D >>> >>> On Thu, Oct 29, 2009 at 10:19 AM, Sujee Maniyam wrote= : >>>> Jean, >>>> that would be the logs =A0under '@hadoop4' section - I believe that wa= s >>>> the region server holding the server at the time >>>> thanks >>>> Sujee >>>> >>>> On Thu, Oct 29, 2009 at 9:32 AM, Jean-Daniel Cryans wrote: >>>>> 14 minutes seems way too much, anything relevant in the region server >>>>> logs around the same time? (The one who holds the region at that >>>>> point) >>>>> >>>> >>> >> >> >> >> -- >> http://sujee.net >> > --=20 http://sujee.net