Return-Path: Delivered-To: apmail-hadoop-hbase-user-archive@minotaur.apache.org Received: (qmail 68441 invoked from network); 12 Jun 2009 05:19:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 12 Jun 2009 05:19:46 -0000 Received: (qmail 62711 invoked by uid 500); 12 Jun 2009 05:19:57 -0000 Delivered-To: apmail-hadoop-hbase-user-archive@hadoop.apache.org Received: (qmail 62668 invoked by uid 500); 12 Jun 2009 05:19:57 -0000 Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-user@hadoop.apache.org Delivered-To: mailing list hbase-user@hadoop.apache.org Received: (qmail 62658 invoked by uid 99); 12 Jun 2009 05:19:57 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Jun 2009 05:19:57 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of bradfordstephens@gmail.com designates 74.125.46.29 as permitted sender) Received: from [74.125.46.29] (HELO yw-out-2324.google.com) (74.125.46.29) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Jun 2009 05:19:47 +0000 Received: by yw-out-2324.google.com with SMTP id 9so1016086ywe.29 for ; Thu, 11 Jun 2009 22:19:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=K0CQzSK19yG4JGxCXZut03y77ZOkPVYUif8S3PjIoqw=; b=i/o052JnPNZ46lz7YqEZPiBfwoCeKK3cSQBPw/JoZGNnu4VMFxfFOVBIQycwWsc7Gy DEWDIkhZuENtYrRBCb5jA1pN6l2O38uE2YIOBT88SAVUzQ1DkM3zbm3qEBt73MJDqO4m C0B9uy0DM8FnPz+j901WBCkhV87fjgyktN0eQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=Q66w462NOa3Hq/SDHjqQJiLBRgq59G9ZIb9xUvMKXFKo1A9ijPYG/pZ3urxSxL/KiH HG7lRA8WL4aMd3VvEw5t0d7axYKKE6WF0DHJDRnHu37bbXyFk3kfeGFGO/6cBzqqXhfe JFkcwDsN8T9x4RohO8JwrXDLpntjjUucfUHSc= MIME-Version: 1.0 Received: by 10.90.93.13 with SMTP id q13mr2832424agb.79.1244783966847; Thu, 11 Jun 2009 22:19:26 -0700 (PDT) In-Reply-To: <7c962aed0906112147i2cc699d3j8a193bc7c37d6255@mail.gmail.com> References: <860544ed0906111810l2f80be29x8bc08a7463fc2b4b@mail.gmail.com> <7c962aed0906112147i2cc699d3j8a193bc7c37d6255@mail.gmail.com> Date: Thu, 11 Jun 2009 22:19:26 -0700 Message-ID: <860544ed0906112219x8d10ab0p78287d2d5372ce06@mail.gmail.com> Subject: Re: HBase Write to Regionservers behavior From: Bradford Stephens To: hbase-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org That actually make a lot of sense. Thanks, awesome people! Me and the dev team are here to get Katta + HBase to play together, and it's looking pretty nice. On Thu, Jun 11, 2009 at 9:47 PM, stack wrote: > On Thu, Jun 11, 2009 at 6:10 PM, Bradford Stephens < > bradfordstephens@gmail.com> wrote: > >> >> What I'm noticing is that it's writing to mostly one or two regions on >> one box at a time, even though I have 7 reducers running. Monitoring >> everything with dstat -v, I notice that only 2 of my servers are doing >> much. These boxes have very low CPU idling, and high disk output (a >> few GB a minute). >> > > > How many regions in your table? > > At first, there is one. =A0All reducers will go against it. =A0 When it s= plits, > then two regions field the 7 reducers and so on. > > You can manually split regions from the command-line. =A0See if that help= s: > > hbase> split_region 'REGIONNAME' > > (IIRC -- type 'tools' in shell for help on the admin facilities). > > St.Ack >