Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9CE9CC140 for ; Sun, 12 Aug 2012 14:24:02 +0000 (UTC) Received: (qmail 46290 invoked by uid 500); 12 Aug 2012 14:24:00 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 46242 invoked by uid 500); 12 Aug 2012 14:24:00 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 46234 invoked by uid 99); 12 Aug 2012 14:24:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Aug 2012 14:24:00 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of gurjeet@gmail.com designates 209.85.160.41 as permitted sender) Received: from [209.85.160.41] (HELO mail-pb0-f41.google.com) (209.85.160.41) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Aug 2012 14:23:51 +0000 Received: by pbbro12 with SMTP id ro12so6581419pbb.14 for ; Sun, 12 Aug 2012 07:23:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:references:from:content-type:x-mailer:in-reply-to :message-id:date:to:content-transfer-encoding:mime-version; bh=pgKc/7CBkku6TGWdSk770mRKnzVnxx0GIWoFqpkbhho=; b=CR7LXZkUsjUc0nMtslBG37ID4oFtqPKNLpECtFBtslhdYLCo0q1V9n6hr+OCb1KTLG ylu2rVltcFv9dSuZFSK0mAV9ZPGQWRipIi0gy4SHk2HJT0EgKiCs3qNuXOOlvLkKzXSa hB3VxpoljhV/f7Gi302Lz29/56RDdxeR9Q7YZnO6A2N4vcIiwzMoTVPbvvlSBeAk45Hp 3dzUI8oM+ZBy03LUT1NnVLKJMr9KbpIdrroZaRGzOd27x+4aGyzSnmd0ElmZl6KJnAZW EJA7KX0hODqZ6gnxizrXpDuv2kuwu8YS5X7+01CQwlKQl8ORiQUITDVkWV08eEdi6J64 LnvA== Received: by 10.66.76.9 with SMTP id g9mr19483204paw.62.1344781410118; Sun, 12 Aug 2012 07:23:30 -0700 (PDT) Received: from [10.0.1.6] (c-24-130-145-10.hsd1.ca.comcast.net. [24.130.145.10]) by mx.google.com with ESMTPS id oa5sm3401088pbb.14.2012.08.12.07.23.28 (version=TLSv1/SSLv3 cipher=OTHER); Sun, 12 Aug 2012 07:23:29 -0700 (PDT) Subject: Re: Slow full-table scans References: From: Gurjeet Singh Content-Type: text/plain; charset=us-ascii X-Mailer: iPad Mail (9B206) In-Reply-To: Message-Id: Date: Sun, 12 Aug 2012 07:23:28 -0700 To: "user@hbase.apache.org" Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) Hi Ted, Yes, I am using the cloudera distribution 3. Gurjeet Sent from my iPad On Aug 12, 2012, at 7:11 AM, Ted Yu wrote: > Gurjeet: > Can you tell us which HBase version you are using ? > > Thanks > > On Sun, Aug 12, 2012 at 5:32 AM, Gurjeet Singh wrote: > >> Thanks for the reply Stack. My comments are inline. >> >>> You've checked out the perf section of the refguide? >>> >>> http://hbase.apache.org/book.html#performance >> >> Yes. HBase has 8GB RAM both on my cluster as well as my dev machine. >> Both configurations are backed by SSDs and Hbase options are set to >> >> HBASE_OPTS="-ea -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode" >> >> The data that I am dealing with is static. The table never changes >> after the first load. >> >> Even some of my GET requests are taking up to a full 60 seconds when >> the row sizes reach ~10MB. In general, taking 5 seconds to fetch a >> single row (~1MB) seems a extremely high to me. >> >> Thanks again for your help. >>