Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CADD9F963 for ; Thu, 4 Apr 2013 00:37:47 +0000 (UTC) Received: (qmail 19453 invoked by uid 500); 4 Apr 2013 00:37:45 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 19380 invoked by uid 500); 4 Apr 2013 00:37:45 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 19371 invoked by uid 99); 4 Apr 2013 00:37:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Apr 2013 00:37:45 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of r6squeegee@gmail.com designates 209.85.212.182 as permitted sender) Received: from [209.85.212.182] (HELO mail-wi0-f182.google.com) (209.85.212.182) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Apr 2013 00:37:41 +0000 Received: by mail-wi0-f182.google.com with SMTP id hi18so2090538wib.3 for ; Wed, 03 Apr 2013 17:37:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=fYA8y51ayhxsEmXmUre6JL+Gl3On1PgkNirv+1zzxoA=; b=K3WeI3T4GSeSNTmzTvjlKmbiwQa0fMUkY/vLEuaN0mlSG1aSnv8g1Th9D8Fr+JN4uH /PL2crxdtMoVc9X3PuGmmqS4kXKnXMY62DpGGy+DmVxdbWXKMAcUK5sZlFnficZ2b1Um RJJFsoR7cprAcK0+QMU70MpmYHduLanjq8YuuAYRKao7FI+Ywd1qwxHZE8RcZQ4FP7Vd 8wvdTz9s7M62rWNYNkvFDLBBwuvjf2+gTKSPM2ByzlODBAtCjo9zLgd8IOSqApQ3rEWF T/3/aBAo9MpGase/fvr0bk8IH0X4JioAaJ4V+8xGeFZ9+rxEX1Py7bmSlbBmzCIkY7vb MQbQ== MIME-Version: 1.0 X-Received: by 10.180.11.136 with SMTP id q8mr5807236wib.18.1365035840052; Wed, 03 Apr 2013 17:37:20 -0700 (PDT) Received: by 10.194.110.231 with HTTP; Wed, 3 Apr 2013 17:37:19 -0700 (PDT) In-Reply-To: References: <515C8F2E.9060300@kickflop.net> <515C95FA.7030909@kickflop.net> Date: Thu, 4 Apr 2013 11:37:19 +1100 Message-ID: Subject: Re: Failing to get Snappy working (hours now - native snappy library not available) - Help? From: Ted To: user@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org btw, if you happen to be using something like fedora... the following easy 4 steps worked for me - on fedora yum install snappy - ln -s /usr/lib64/libsnappy.so.1.1.3 /opt/hbase/lib/native/Linux-amd-64-64/libsnappy.so - ln -s /opt/hadoop/lib/native/Linux-amd64-64/libhadoop.so.1.0.0 /opt/hbase/lib/native/Linux-amd-64-64/libhadoop.so - test it with : bin/hbase org.apache.hadoop.hbase.util.CompressionTest file:///tmp/snappy snappy It might save you all the fuss with building and installing snappy if you just use the provided OS packages (some one will probably tell me it's the wrong version now :) ) On 4/4/13, Andrew Purtell wrote: > Yes Jeff, I agree and will take care of it. Thanks for bringing this to our > attention. > > On Wednesday, April 3, 2013, Jeff Blaine wrote: > >> On 4/3/2013 4:42 PM, Andrew Purtell wrote: >> >>> Make sure the path to the libhadoop SO is on LD_LIBRARY_PATH or >>> somewhere >>> in /etc/ld.so.conf (and if the latter then also rebuild the ld cache >>> with >>> /sbin/ldconfig) >>> >> >> Thanks Andrew. >> >> If that's required to even get things working, shouldn't the >> documentation mention that? :( >> >> On Wednesday, April 3, 2013, Jeff Blaine wrote: >>> >>> Hello, >>>> >>>> I cannot see what is amiss with the following configuration. I have >>>> followed, to the best of my knowledge, the instructions to a "T". >>>> >>>> If anyone could shed some light, I would be grateful. All HBase >>>> hosts have the exact same configuration shown below and non-SNAPPY >>>> table operations work fine... >>>> >>>> $ id >>>> uid=30000(hadoop) gid=30000(hadoop) groups=30000(hadoop) >>>> $ uname -i >>>> x86_64 >>>> $ pwd >>>> /hbase-0.92.2 >>>> $ grep HBASE_LIBRARY_PATH conf/hbase-env.sh >>>> export HBASE_LIBRARY_PATH="/hadoop-1.****0.4/lib/native/Linux-amd64-** >>>> 64" >>>> $ cd /hadoop-1.0.4/lib/native/****Linux-amd64-64 >>>> $ ls -l >>>> total 1456 >>>> -rw-rw-r-- 1 hadoop root 405228 Oct 3 05:14 libhadoop.a >>>> -rw-rw-r-- 1 hadoop root 878 Oct 3 05:14 libhadoop.la >>>> -rw-rw-r-- 1 hadoop root 219217 Oct 3 05:14 libhadoop.so >>>> -rw-rw-r-- 1 hadoop root 219217 Oct 3 05:14 libhadoop.so.1 >>>> -rw-rw-r-- 1 hadoop root 219217 Oct 3 05:14 libhadoop.so.1.0.0 >>>> -rw-rw-r-- 1 hadoop ubuntu 136297 Apr 3 19:46 libsnappy.so >>>> -rw-rw-r-- 1 hadoop ubuntu 136297 Apr 3 19:47 libsnappy.so.1 >>>> -rw-rw-r-- 1 hadoop ubuntu 136297 Apr 3 19:46 libsnappy.so.1.1.4 >>>> $ /hbase-0.92.2/bin/hbase shell >>>> HBase Shell; enter 'help' for list of supported commands. >>>> Type "exit" to leave the HBase Shell >>>> Version 0.92.2, r1379292, Fri Aug 31 13:13:53 UTC 2012 >>>> >>>> hbase(main):001:0> create 'non', 'cf' >>>> 0 row(s) in 4.0720 seconds >>>> >>>> hbase(main):002:0> create 'comp', { NAME => 'foo', COMPRESSION => >>>> 'SNAPPY' >>>> } >>>> [ The command above never returns ] >>>> ^C >>>> $ >>>> >>>> Logs show: >>>> >>>> 2013-04-03 18:07:11,992 WARN org.apache.hadoop.io.compress.** >>>> **snappy.LoadSnappy: >>>> Snappy native library not loaded >>>> java.io.IOException: java.lang.RuntimeException: native snappy library >>>> not >>>> available >>>> >>>> >>> >>> > > -- > Best regards, > > - Andy > > Problems worthy of attack prove their worth by hitting back. - Piet Hein > (via Tom White) > -- Ted.