Return-Path: Delivered-To: apmail-hbase-user-archive@www.apache.org Received: (qmail 93121 invoked from network); 24 Sep 2010 23:21:35 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 24 Sep 2010 23:21:35 -0000 Received: (qmail 57241 invoked by uid 500); 24 Sep 2010 23:21:34 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 57193 invoked by uid 500); 24 Sep 2010 23:21:34 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 57185 invoked by uid 99); 24 Sep 2010 23:21:34 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Sep 2010 23:21:34 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of magnito@gmail.com designates 209.85.214.169 as permitted sender) Received: from [209.85.214.169] (HELO mail-iw0-f169.google.com) (209.85.214.169) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Sep 2010 23:21:27 +0000 Received: by iwn33 with SMTP id 33so3836965iwn.14 for ; Fri, 24 Sep 2010 16:21:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=5HrhQblXMxRde0wgdwEfrYY/8/WGv7fAt9Viykak/Cs=; b=BVDCRHQqs6RQTFAE7XFhrggeB888ijehhTS2BxnGT9SoJ569Cr2lxYls+J6BQIPdq3 FvmRE/ATRQ1HoykY67O+KXwMMf4b6iT0704ANb9sydZkyhfYNLkkZOitcWRsMSuDnAzC Cq+Q5eUScuVkPnHmAcmQoXRYocxHvIVKTgU+Q= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=dMkXrIGwORer6UNXp2eyWuD2Uk8efdHfcFI+cmGfz/p02OseqQmPB5UTYZSFkgYXok lGLuRbEPhYMf+0hrPEweuNsPiKHTV8qEgjGPujyidAt0lUwyteXuUnjGBxkEw8WCTRMh c3c5nJo96Cc0y2mrxxq7z43EwQryYFgUYFgMA= MIME-Version: 1.0 Received: by 10.231.146.135 with SMTP id h7mr4470266ibv.149.1285370465414; Fri, 24 Sep 2010 16:21:05 -0700 (PDT) Received: by 10.231.194.209 with HTTP; Fri, 24 Sep 2010 16:21:05 -0700 (PDT) In-Reply-To: References: <23C7490C-9994-48DB-BAC2-13D2D66F8884@gmail.com> Date: Fri, 24 Sep 2010 16:21:05 -0700 Message-ID: Subject: Re: Regions loading too fast From: Jack Levin To: user@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Also, even with '1' value, I see: 2010-09-24 16:20:29,983 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: img834,1000351n.jpg,1285251664421.d09510a16c0cfd0d8a251a36229125e0. 2010-09-24 16:20:29,984 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: img651,pict1408.jpg,1285018965749.110871465 2010-09-24 16:20:29,984 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: img806,sam0084a.jpg,1285324613056.82a1e8ba8d2a37a591a847fb36803c45. 2010-09-24 16:20:29,985 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: img535,screenshot1bt.png,1285323376435.fae5f3ab474196c99f10b8a936fb9ead. 2010-09-24 16:20:29,985 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: img838,123468.jpg,1285223690165.a2903008621d1a6b6ca02441bf3b68ea. 2010-09-24 16:20:29,985 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: img839,yug.jpg,1285230318537.c09323dbaf54130671df2a14d671fe25. 2010-09-24 16:20:29,985 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: img821,vlcsnap78737.png,1285283076812.ea4973ce6e43d7f974613c5989647278. 2010-09-24 16:20:29,985 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: img805,njt30scbkdmb.gif,1285322429401.f9aacdafd8064bfbcc8cd4f6930febbe. 2010-09-24 16:20:29,985 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: img94,img1711m.jpg,1285016850260.1424182007 2010-09-24 16:20:29,986 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Creating region img840,kitbarca2.png,1285189312696.1ce170ec09384fca51297a5fe7aeb4af. Which is pretty close to concurrent. -Jack On Fri, Sep 24, 2010 at 4:16 PM, Jack Levin wrote: > Still having a problem: > > 2010-09-24 16:15:02,572 ERROR > org.apache.hadoop.hbase.regionserver.HRegionServer: Error opening > img695,p1908101232.jpg,1285288492084.d451f05024b42f71a115951c62cdcccf. > java.io.EOFException > =A0 =A0 =A0 =A0at java.io.DataInputStream.readFully(DataInputStream.java:= 180) > =A0 =A0 =A0 =A0at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(Data= OutputBuffer.java:63) > =A0 =A0 =A0 =A0at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputB= uffer.java:101) > =A0 =A0 =A0 =A0at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceF= ile.java:1937) > =A0 =A0 =A0 =A0at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceF= ile.java:1837) > > > I changed the value to '1', and restarted the regionserver... Note > that my hdfs is not having a problem. > > -Jack > > On Fri, Sep 24, 2010 at 4:01 PM, Stack wrote: >> Try >> >> =A0 >> =A0 =A0hbase.regions.percheckin >> =A0 =A010 >> =A0 =A0Maximum number of regions that can be assigned in a = single go >> =A0 =A0to a region server. >> =A0 =A0 >> =A0 >> >> What do you have now? =A0Whatever it is, go down from there. >> >> St.Ack >> >> >> On Fri, Sep 24, 2010 at 3:07 PM, Jack Levin wrote: >>> My regions are 1gb in size and when I cold start the cluster I oversatu= rate my network links (1000 mbps) and get client dfs timeouts , anyway to s= low the m down? >>> >>> -Jack >>> >>> >> >