Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 710E3200D12 for ; Sat, 7 Oct 2017 19:16:44 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 6EE731609DF; Sat, 7 Oct 2017 17:16:44 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B48E41609DA for ; Sat, 7 Oct 2017 19:16:43 +0200 (CEST) Received: (qmail 43054 invoked by uid 500); 7 Oct 2017 17:16:42 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 43040 invoked by uid 99); 7 Oct 2017 17:16:42 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 07 Oct 2017 17:16:42 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 4F52D180703 for ; Sat, 7 Oct 2017 17:16:41 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.992 X-Spam-Level: ** X-Spam-Status: No, score=2.992 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id B_4LGAZ0O4ew for ; Sat, 7 Oct 2017 17:16:39 +0000 (UTC) Received: from mail-qt0-f178.google.com (mail-qt0-f178.google.com [209.85.216.178]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 35A565FC8A for ; Sat, 7 Oct 2017 17:16:39 +0000 (UTC) Received: by mail-qt0-f178.google.com with SMTP id q4so36652692qtq.8 for ; Sat, 07 Oct 2017 10:16:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=muZLtThrEft8/xaesbE9cS9nFkVFDgAlBSJkQq1gNtE=; b=q3g6c1nECBC6DkQhCFDROWHX6daDUOsKE7W3CQ0ScwJfdQ8xGQHR3cz+dnaFhyFWHu X0/iH4vxsJrR4oSDll0oK0QaP023ewvasi4qadmDA8bhnUIbwMVcXxbbAVApEpw3Yluk qcyAMWXjvg9lBENncUTtmVnnVx5Dii8WRWH96AlX38BITGc2flE2xRkh4l5lGgly2lNu wzGsEMIJhRj9LXuLvXhPpkG9gFRDeMFNECz1TkNN33dOo9L1miKB7lj2P/n60m1q3M+q zBswfeP8qbFJC58A92M3bWxxc+3rUue46ojaXPBAd9DIKL92IY6pxTwDv6YKy2sjD71h VIBw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=muZLtThrEft8/xaesbE9cS9nFkVFDgAlBSJkQq1gNtE=; b=gWx1vIAUlcmo935fEPm+iXuuNxQjJgEkr39Ks7KQ7ea7VS3JYeZUZgGNc28Z4Pq9fd tclqc0bjHOz3TCte/1OqpMKldgNV1l/b2Af1W10V0L6YIagmLLsNENPPdA2we1HE3zFL dyjJIDmxPuskC0B7n4tc2+hZWSgT/9NHUHqcFxlho6cVZGJYZ06vhSo5AHM6JYVNgmn7 2LN16oP+4yj+KWwQbpZFWIFNdf78H3rRUqCf2nPbZ8pVbRt939o1DZsmMkZTNZTBcudC Rp6jH5OSX9nWaV2+j242voAkg7CXvr4EYZd+uv/k5UGU0W2p6cAtTtk/JONmsHjquA81 AUIw== X-Gm-Message-State: AMCzsaVFDaF0n2KiTvNCd4fdgdMS7i1s59c6ng3VVm692RUfmsbrGNVz 0bPHQPexhHg/1aLmnzCmp+NJpnvAciPMhMuQYKS7cA== X-Google-Smtp-Source: AOwi7QCeCHDMXwOqeqsZQIa+jPJYsmyAuiNMeQneCMBfhFgBcGtlzzpwtXvjmm67yWDFC73CJBOJ3VpVDtHs9SrHpis= X-Received: by 10.129.48.10 with SMTP id w10mr4640032yww.378.1507396597846; Sat, 07 Oct 2017 10:16:37 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.163.195 with HTTP; Sat, 7 Oct 2017 10:16:37 -0700 (PDT) In-Reply-To: <1507395566973-0.post@n3.nabble.com> References: <1507395566973-0.post@n3.nabble.com> From: Ted Yu Date: Sat, 7 Oct 2017 10:16:37 -0700 Message-ID: Subject: Re: Strategies to query efficiently in HBase To: "user@hbase.apache.org" Content-Type: multipart/alternative; boundary="001a11413534c017d6055af81e2e" archived-at: Sat, 07 Oct 2017 17:16:44 -0000 --001a11413534c017d6055af81e2e Content-Type: text/plain; charset="UTF-8" What's the value for hbase.hregion.max.filesize ? By default it is 10GB. bq. any other scan including startrow and stoprow Did the start / stop rows encompass the 3 regions ? Please also see http://hbase.apache.org/book.html#ops.date.tiered Cheers On Sat, Oct 7, 2017 at 9:59 AM, sauloricci wrote: > I've designed HBase table where my rowkey is driven to the queries that I > need to run on it. Following the best practices I included a hashed portion > as prefix of my rowkeys, trying to spread the rows as much uniform as > possible across my table regions. > > I'm concerned about the following scenario: > > I got billions of rows in my HBase table split between 3 regions. I'm using > this table to provide data for a REST API, and because that, it needs to > provide the rows as fast as possible. > > Unfortunately, I'm hitting the famous timeout error Failed to get result > within timeout, timeout=60000ms even if I invoke either count "table_name" > in the hbase shell or for any other scan including startrow and stoprow > parameters.It seems scanning by ranges using the rowkey is sweeping the > whole hbase table. > > Considering this scenario I'd like to ask 2 questions: > > 1) Is there any strategy to really retrieve range of rows as fast as > possible without hitting the timeout error? I really appreciate any > pointers > here. > > 2) As I'm new in HBase, do you think HBase is the best or at least adequate > solution to provide fast retrieval data to a REST API, considering the > search are in fact scans by range of rowkeys? > > > > -- > Sent from: http://apache-hbase.679495.n3.nabble.com/HBase-User- > f4020416.html > --001a11413534c017d6055af81e2e--