Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 913FD181A2 for ; Mon, 1 Jun 2015 14:24:13 +0000 (UTC) Received: (qmail 92375 invoked by uid 500); 1 Jun 2015 14:24:10 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 92305 invoked by uid 500); 1 Jun 2015 14:24:10 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 92286 invoked by uid 99); 1 Jun 2015 14:24:10 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Jun 2015 14:24:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id B9A0F181A34 for ; Mon, 1 Jun 2015 14:24:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.88 X-Spam-Level: ** X-Spam-Status: No, score=2.88 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id ZZLA-AFRNDz9 for ; Mon, 1 Jun 2015 14:24:03 +0000 (UTC) Received: from mail-la0-f50.google.com (mail-la0-f50.google.com [209.85.215.50]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id B244B428E3 for ; Mon, 1 Jun 2015 14:24:02 +0000 (UTC) Received: by laei3 with SMTP id i3so15052535lae.3 for ; Mon, 01 Jun 2015 07:23:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-type; bh=WW8XsW3dI9YvEq7/6v4246hnN7NBg+ulk7gpNLpfS8o=; b=N0GUCkYR9zjt8o3TDo+iT2q6RQQgq2EWbbiIgRLDL1i+hcW1q2G1GeIZhqH6ighq4P a/trzdf0XGX2KyGD0peNnXm01OQQPbonR/08vXHu0mhc8fhqT00che8UgHmzmmp8it8S qih0V6JrRrV3Huvvk3gEgdrlHlcBYxA17BDW1YfJY9wN/5vcRCwv2MfftrXAHSO2akbB v6vndPEtQfkHp2FpkxPhR2ZXWpT4yEt27AVs0A65cGXK86Z/OvidGClqMPin4rtEm0Eg j12SxaOPKLH2kFnRZDQxaarabQZk6voEC8jYnE2Fdcy/3O35Gx//tZwyb47Y3wCydhth MbwA== X-Received: by 10.152.19.162 with SMTP id g2mr21089701lae.46.1433168634792; Mon, 01 Jun 2015 07:23:54 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Dejan Menges Date: Mon, 01 Jun 2015 14:23:44 +0000 Message-ID: Subject: Re: hfile.bucket.BucketAllocatorException: Allocation too big size To: "user@hbase.apache.org" Content-Type: multipart/alternative; boundary=089e013d186c6154e605177593f6 --089e013d186c6154e605177593f6 Content-Type: text/plain; charset=UTF-8 Hi Ted, It's 0.98.0 with bunch of patches (from Hortonworks). Let me try with that key, on my way :) On Mon, Jun 1, 2015 at 4:19 PM Ted Yu wrote: > Which hbase release are you using ? > > I seem to recall that hbase.bucketcache.bucket.sizes was the key. > > Cheers > > On Mon, Jun 1, 2015 at 7:04 AM, Dejan Menges > wrote: > > > Hi, > > > > I'm getting messages like: > > > > 015-06-01 14:02:29,529 WARN > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache: Failed allocating > for > > block ce18012f4dfa424db88e92de29e76a9b_25809098330 > > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketAllocatorException: > > Allocation too big size=750465 > > > > at > > > > org.apache.hadoop.hbase.io > .hfile.bucket.BucketAllocator.allocateBlock(BucketAllocator.java:400) > > > > at > > > > org.apache.hadoop.hbase.io > .hfile.bucket.BucketCache$RAMQueueEntry.writeToCache(BucketCache.java:1153) > > > > at > > > > org.apache.hadoop.hbase.io > .hfile.bucket.BucketCache$WriterThread.doDrain(BucketCache.java:703) > > > > at > > > > org.apache.hadoop.hbase.io > .hfile.bucket.BucketCache$WriterThread.run(BucketCache.java:675) > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > However, not sure why is this. If I understood it correctly (and > probably I > > didn't :/) this should fit in one of those: > > > > > > > > hbase.bucketcache.sizes > > > > 65536,131072,196608,262144,327680,393216,655360,1310720 > > > > > > > > In the same time, hbase,bucketcache.size is 24G. Not sure what I did > > (again) wrong? > > > --089e013d186c6154e605177593f6--