Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1B2ADFB53 for ; Wed, 1 May 2013 18:53:46 +0000 (UTC) Received: (qmail 39392 invoked by uid 500); 1 May 2013 18:53:44 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 39307 invoked by uid 500); 1 May 2013 18:53:44 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 39298 invoked by uid 99); 1 May 2013 18:53:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 May 2013 18:53:43 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates 209.85.217.170 as permitted sender) Received: from [209.85.217.170] (HELO mail-lb0-f170.google.com) (209.85.217.170) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 May 2013 18:53:37 +0000 Received: by mail-lb0-f170.google.com with SMTP id r10so1718387lbi.15 for ; Wed, 01 May 2013 11:53:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=ZEOBirjb1TNSg7+f+Fcbd7BALKrTxAfjXwKAZdrdqrs=; b=D/s0tuDP+/ynIyV3JqixIaifEO0uy4bxDs2vzSvEK3GTeGg8snmw10XWu+6njMIKjb H1QeVFKPOakgJO/3QTEGvNXp07FnwQwdXmXsap9PQm7jivrK4UdhG5lzOnmgIzMRxEqF 6Khq3+W9smFiYzhO0bToUOTfTnZLlQm1zZ2BBYHMsn9ffNE3i3hy5sgSAI/gw3vSrbER YmJ/5AD4ULqjCSBtfyIfHZGAMojX42yzlGh7ARLRFTTeOeCZRGlH+Yde+27doPp4JxEH 0gk6iGS5BnScEe/Ssx1cytDZuz+NJzTH3TPC0w3JkO4E16lg7PkuaT9zd3vQ9YWO0u6C mHtA== MIME-Version: 1.0 X-Received: by 10.152.120.40 with SMTP id kz8mr1366322lab.32.1367434396333; Wed, 01 May 2013 11:53:16 -0700 (PDT) Received: by 10.112.136.104 with HTTP; Wed, 1 May 2013 11:53:16 -0700 (PDT) In-Reply-To: References: Date: Wed, 1 May 2013 11:53:16 -0700 Message-ID: Subject: Re: Advice on setting default HBase table mapping attributes within Apache Gora From: Ted Yu To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=089e012281b4731f2704dbaca114 X-Virus-Checked: Checked by ClamAV on apache.org --089e012281b4731f2704dbaca114 Content-Type: text/plain; charset=ISO-8859-1 0.90.x code base is no longer actively maintained. Looking forward to the upgrade of HBase in Gora. On Wed, May 1, 2013 at 11:49 AM, Lewis John Mcgibbney < lewis.mcgibbney@gmail.com> wrote: > Hi Ted, > Thank you for reply. > This is where I drop a bomb... which I reservedly apologize for, I should > have dropped in original email. > We currently pull 0.90.4 maven artifact within Gora trunk! > We plan to upgrade to 0.94.X [0] after our next release (next few weeks) > Thanks Ted > [0] https://issues.apache.org/jira/browse/GORA-201 > > > On Wed, May 1, 2013 at 11:45 AM, Ted Yu wrote: > > > What version of HBase are you using ? > > > > Assuming it is 0.94.x, you can find the default values > > in src/main/resources/hbase-default.xml > > e.g. > > > > hfile.block.cache.size > > 0.25 > > > > Percentage of maximum heap (-Xmx setting) to allocate to block > > cache > > used by HFile/StoreFile. Default of 0.25 means allocate 25%. > > Set to 0 to disable but it's not recommended. > > > > > > > > Cheers > > > > On Wed, May 1, 2013 at 11:40 AM, Lewis John Mcgibbney < > > lewis.mcgibbney@gmail.com> wrote: > > > > > Hi, > > > > > > Currently in Gora, we support the following table attributes, which we > > > specify when mapping data into HBase; > > > compression, blockCache, blockSize, bloomFilter, maxVersions, > timeToLive, > > > inMemory . > > > These expand to the following > > > > > > HColumnDescriptor columnDescriptor = getOrCreateFamily(familyName, > > > families); > > > > > > if(compression != null) > > > > > > columnDescriptor.setCompressionType(Algorithm.valueOf(compression)); > > > if(blockCache != null) > > > > > > > columnDescriptor.setBlockCacheEnabled(Boolean.parseBoolean(blockCache)); > > > if(blockSize != null) > > > columnDescriptor.setBlocksize(Integer.parseInt(blockSize)); > > > if(bloomFilter != null) > > > > > > columnDescriptor.setBloomFilterType(BloomType.valueOf(bloomFilter)); > > > if(maxVersions != null) > > > columnDescriptor.setMaxVersions(Integer.parseInt(maxVersions)); > > > if(timeToLive != null) > > > columnDescriptor.setTimeToLive(Integer.parseInt(timeToLive)); > > > if(inMemory != null) > > > columnDescriptor.setInMemory(Boolean.parseBoolean(inMemory)); > > > } > > > > > > Within GORA-218[0], it is our intention to add default values for such > > > attributes and document a bit about them as well. Currently an example > of > > > our hbase mapping file is here [1]. As you can see, the table block > only > > > has the name attribute, the remaining ones below are missing. > > > > > > Some guidance on setting these defaults and a brief explanation of what > > > they do would be very much appreciated. > > > > > > Thank you very much in advance for anyone able to help us out on this > > one. > > > > > > Lewis > > > > > > [0] https://issues.apache.org/jira/browse/GORA-218 > > > [1] > > > > > > > > > http://svn.apache.org/repos/asf/gora/trunk/gora-hbase/src/test/conf/gora-hbase-mapping.xml > > > > > > -- > > > *Lewis* > > > > > > > > > -- > *Lewis* > --089e012281b4731f2704dbaca114--