Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D901D9842 for ; Wed, 25 Apr 2012 01:59:24 +0000 (UTC) Received: (qmail 29261 invoked by uid 500); 25 Apr 2012 01:59:22 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 29216 invoked by uid 500); 25 Apr 2012 01:59:22 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 29208 invoked by uid 99); 25 Apr 2012 01:59:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Apr 2012 01:59:22 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of michael_segel@hotmail.com designates 65.55.90.111 as permitted sender) Received: from [65.55.90.111] (HELO snt0-omc2-s36.snt0.hotmail.com) (65.55.90.111) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Apr 2012 01:59:16 +0000 Received: from SNT0-EAS341 ([65.55.90.73]) by snt0-omc2-s36.snt0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Tue, 24 Apr 2012 18:58:55 -0700 X-Originating-IP: [166.205.142.95] X-Originating-Email: [michael_segel@hotmail.com] Message-ID: Subject: Re: Hbase Quality Of Service: large standarad deviation in insert time while inserting same type of rows in Hbase References: <33740438.post@talk.nabble.com> From: Michael Segel Content-Type: text/plain; charset="us-ascii" In-Reply-To: <33740438.post@talk.nabble.com> Date: Tue, 24 Apr 2012 18:58:53 -0700 To: "user@hbase.apache.org" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 (1.0) X-OriginalArrivalTime: 25 Apr 2012 01:58:55.0627 (UTC) FILETIME=[F8A705B0:01CD2286] X-Virus-Checked: Checked by ClamAV on apache.org Have you thought about Garbage Collection? -Grover Sent from my iPhone On Apr 24, 2012, at 12:41 PM, "Skchaudhary" wrote: >=20 > I have a cluster Hbase set-up. In that I have 3 Region Servers. There is a= > table which has 27 Regions equally distributed among 3 Region servers--9 > regions per region server. >=20 > Region server 1 has ---region 1-9 Region server 2 has ---region 10-18 Regi= on > server 3 has ---region 19-27 >=20 > Now when I start a program which inserts rows in region 1 and region 5 (bo= th > under Region Server-1) alternatively and on continuous basis, I see that t= he > insert time for each row is not constant or consistent---there is a lot of= > variance or say standard deviation of insert time is quite large. Some tim= es > it takes 2 ms to insert a row, sometimes 3 ms,sometimes 1000 ms and > sometimes even > 3000 ms.Even though data size in rows is equal. >=20 > I understand that due to flushing and compaction of Regions the writes are= > blocked---but then it should not be blocked for larger span of time and th= e > blockage time should be consistent for every flush/compaction (minor > compaction). >=20 > All in all every time flush and compaction occurs it should take nearly sa= me > time for each compaction and flush. >=20 > For our application we need a consistent quality of service and if not > perfect atleast we need a well visible boundary lines--like for each row > insert it will take some 0 to 10 ms and not more than 10 ms(just an exampl= e) > that even though minor compaction or flush occurs. >=20 > Is there any setting/configuration which I should try? >=20 > Any ideas of how to achieve it in Hbase. >=20 > Any help would be really appreciated. >=20 > Thanks in advance!! >=20 > --=20 > View this message in context: http://old.nabble.com/Hbase-Quality-Of-Servi= ce%3A-large-standarad-deviation-in-insert-time-while-inserting-same-type-of-= rows-in-Hbase-tp33740438p33740438.html > Sent from the HBase User mailing list archive at Nabble.com. >=20