Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6A875E598 for ; Wed, 21 Nov 2012 21:22:07 +0000 (UTC) Received: (qmail 23481 invoked by uid 500); 21 Nov 2012 21:22:05 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 23410 invoked by uid 500); 21 Nov 2012 21:22:05 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 23399 invoked by uid 99); 21 Nov 2012 21:22:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Nov 2012 21:22:05 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of michael_segel@hotmail.com designates 65.55.111.112 as permitted sender) Received: from [65.55.111.112] (HELO blu0-omc2-s37.blu0.hotmail.com) (65.55.111.112) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Nov 2012 21:21:59 +0000 Received: from BLU0-SMTP140 ([65.55.111.71]) by blu0-omc2-s37.blu0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Wed, 21 Nov 2012 13:21:37 -0800 X-Originating-IP: [173.15.87.37] X-EIP: [glsykOxKIn4tAARvLWkvEbZWWejboMKM] X-Originating-Email: [michael_segel@hotmail.com] Message-ID: Received: from [192.168.0.104] ([173.15.87.37]) by BLU0-SMTP140.blu0.hotmail.com over TLS secured channel with Microsoft SMTPSVC(6.0.3790.4675); Wed, 21 Nov 2012 13:21:36 -0800 Content-Type: text/plain; charset="iso-8859-1" MIME-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: Region hot spotting From: Michael Segel In-Reply-To: Date: Wed, 21 Nov 2012 15:21:34 -0600 Content-Transfer-Encoding: quoted-printable References: <50ac8237.6a00450a.218d.49e2SMTPIN_ADDED@mx.google.com> To: user@hbase.apache.org X-Mailer: Apple Mail (2.1499) X-OriginalArrivalTime: 21 Nov 2012 21:21:36.0619 (UTC) FILETIME=[303123B0:01CDC82E] X-Virus-Checked: Checked by ClamAV on apache.org Salting is not a good idea and I don't know why people suggest it.=20 Case in point.... you want to fetch a single row/record back. Because = the salt is arbitrary, you will need to send N number of get()s one for = each salt value.=20 Doing a simple one way hash of the data, even appending the data, would = be a better idea. Note that if you are worried about key length, you can = do the hash and take the first N bytes and then append the row to it. It = should give you enough of a spread of hash values that you don't have to = worry about hotspots.=20 HTH -Mike On Nov 21, 2012, at 2:44 AM, ramkrishna vasudevan = wrote: > Hi > This link is pretty much useful. But still there too it says if you = dont > pre split you need to wait for the salting to help you from = hotspotting > till the region gets splitted. >=20 > Mohammad just pointing this to say the usefulness of presplitting > definitely your's is a good pointer to Ajay. :) >=20 > Regards > Ram >=20 > On Wed, Nov 21, 2012 at 1:59 PM, Mohammad Tariq = wrote: >=20 >> Hello Ajay, >>=20 >> You can use 'salting' if you don't want to presplit your table. You = might >> this link useful : >>=20 >> = http://blog.sematext.com/2012/04/09/hbasewd-avoid-regionserver-hotspotting= -despite-writing-records-with-sequential-keys/ >>=20 >> HTH >>=20 >> Regards, >> Mohammad Tariq >>=20 >>=20 >>=20 >> On Wed, Nov 21, 2012 at 1:49 PM, ramkrishna vasudevan < >> ramkrishna.s.vasudevan@gmail.com> wrote: >>=20 >>> Hotspotting is bound to happen until the region starts splitting and = gets >>> assigned to diff region servers. >>>=20 >>> Regards >>> Ram >>>=20 >>> On Wed, Nov 21, 2012 at 12:49 PM, Ajay Bhosle >>> wrote: >>>=20 >>>> Hi, >>>>=20 >>>>=20 >>>>=20 >>>> I am inserting some data in hbase which is getting hot spotted in a >>>> particular server. The format of the row key is (0 or >>>> 1)|[timestamp]_[sequence]. Basically I want to add log information = to >>>> hbase >>>> and search the records based on range of dates. >>>>=20 >>>>=20 >>>>=20 >>>> Can someone suggest any configuration changes or any ideas on how = the >> row >>>> key should be design. I do not want to specify the splits while >> creating >>>> table. >>>>=20 >>>>=20 >>>>=20 >>>> Thanks >>>>=20 >>>> Ajay >>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>> The information contained in this electronic message (email) and = any >>>> attachments to this email are intended for the exclusive use of the >>>> addressee(s) and access to this email by any one else is = unauthorised. >>> The >>>> email may contain proprietary, confidential or privileged = information >> or >>>> information relating to Reliance Group. If you are not the intended >>>> recipient, please notify the sender by telephone, fax, or return = email >>> and >>>> delete this communication and any attachments thereto, immediately = from >>>> your computer. Any dissemination, distribution, or copying of this >>>> communication and the attachments thereto (in whole or part), in = any >>>> manner, is strictly prohibited and actionable at law. The recipient >>>> acknowledges that emails are susceptible to alteration and their >>> integrity >>>> can not be guaranteed and that Company does not guarantee that any >> e-mail >>>> is virus-free and accept no liability for any damage caused by any >> virus >>>> transmitted by this email. >>>>=20 >>>=20 >>=20