Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DB704107A3 for ; Mon, 1 Jul 2013 11:11:53 +0000 (UTC) Received: (qmail 49951 invoked by uid 500); 1 Jul 2013 11:11:51 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 49768 invoked by uid 500); 1 Jul 2013 11:11:51 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 49760 invoked by uid 99); 1 Jul 2013 11:11:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Jul 2013 11:11:51 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of vkjk89@gmail.com designates 209.85.223.175 as permitted sender) Received: from [209.85.223.175] (HELO mail-ie0-f175.google.com) (209.85.223.175) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Jul 2013 11:11:45 +0000 Received: by mail-ie0-f175.google.com with SMTP id a13so8231196iee.6 for ; Mon, 01 Jul 2013 04:11:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=uvXaa4wVCwWTl0sqwxF+Op+OzoS1KsGBndqLDJCbAlI=; b=n78G2X/UsoPaFKSxFsOuno1gpX874k39hNdOvArDYiszSWb53HNOTTqAP6GbLG6okP QITOhR4S9U7Bk4kD8LabFOTTVN1zXhDLcO+fZSBzq4XZQVNxtOyzumPAjf3mvHo8InD/ g58G8tCx5IgNqTkrk7m7vxDyB8iKNerXw+6dhVGhchN31wCI4Vmzptrkm5FZghU6Ydv5 vCq7rM7raSxtKEbe7OwC4M7k1Dcfix93NZx5FfqO33WH0xPxTWR/zhKFvzLxM5YtZb7k FrdfI87VdlBjNukSVjsfyA9xk5XSCstTQJhb2aC5xb7CNWI3UNH6fDY7CGWi2yalpucS RJtw== MIME-Version: 1.0 X-Received: by 10.50.17.69 with SMTP id m5mr14825734igd.19.1372677085364; Mon, 01 Jul 2013 04:11:25 -0700 (PDT) Received: by 10.64.81.232 with HTTP; Mon, 1 Jul 2013 04:11:25 -0700 (PDT) In-Reply-To: References: Date: Mon, 1 Jul 2013 16:41:25 +0530 Message-ID: Subject: Re: How many column families in one table ? From: Vimal Jain To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=089e0102f40010884d04e0714a07 X-Virus-Checked: Checked by ClamAV on apache.org --089e0102f40010884d04e0714a07 Content-Type: text/plain; charset=ISO-8859-1 Can someone please reply ? Also what is the typical read/write speed of hbase and how much deviation would be there in my scenario mentioned above (14 cf , total 140 columns ) ? I am asking this because i am not simply printing out the scanned values , instead i am applying some logic on the data retrieved per row basis. So was just curious to find if that small logic in my code is contributing towards the long time taken to scan the table. On Mon, Jul 1, 2013 at 2:41 PM, Vimal Jain wrote: > I scanned it during normal traffic hours.There was no I/O load on the > server. > I dont see any GC locks too. > Also i have given 1.5G to RS , 512M to each Master and Zookeeper. > > One correction in the post above : > Actual time to scan whole table is even more , it takes 10 mins to scan > 0.1 million rows ( so total of 2.5 hours to scan 1.6 million rows) . > The time i mentioned in previous post was for different type of > lookup.Please ignore that. > > > On Mon, Jul 1, 2013 at 2:24 PM, Viral Bajaria wrote: > >> When you did the scan, did you check what the bottleneck was ? Was it I/O >> ? >> Did you see any GC locks ? How much RAM are you giving to your RS ? >> >> -Viral >> >> On Mon, Jul 1, 2013 at 1:44 AM, Vimal Jain wrote: >> >> > To completely scan the table for all 140 columns , it takes around >> 30-40 >> > minutes. >> > >> > > > > -- > Thanks and Regards, > Vimal Jain > -- Thanks and Regards, Vimal Jain --089e0102f40010884d04e0714a07--