Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8844011150 for ; Tue, 26 Aug 2014 13:30:39 +0000 (UTC) Received: (qmail 72961 invoked by uid 500); 26 Aug 2014 13:30:37 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 72888 invoked by uid 500); 26 Aug 2014 13:30:37 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 72871 invoked by uid 99); 26 Aug 2014 13:30:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Aug 2014 13:30:37 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of arthur.hk.chan@gmail.com designates 209.85.192.176 as permitted sender) Received: from [209.85.192.176] (HELO mail-pd0-f176.google.com) (209.85.192.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Aug 2014 13:30:32 +0000 Received: by mail-pd0-f176.google.com with SMTP id y10so22305077pdj.7 for ; Tue, 26 Aug 2014 06:30:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=DVIDbAeDER0BdjsZYDzFQDQSiwSDKYS5yWTfxXv6JIc=; b=IDqlmZSNcb6pZxU8w3ExLytNs1DG2WjRinBQIc6GELN5NXox3B/OGI9FqekWThHNs0 yaIlroYZ7W9WU3B4TdND0VQTILgEIk6V/023aLPN2eYpxxTnP9uSJU3IDCBS4qiIXaDO UWtAqk2eKnPXVTsFjQYrQzflzR6OfHPQRdiJTWMWB47Rs/cIE9j2dQWURBR1OJryFBgz o9gP4pUq4z+hnkELMtdlwPt7EZXKw2GDEuwefQ9xnOz9VE9T5CCUJrWOW0WQutDuaBqo +nq/yh2fkffpQSj1M916Jii0kkYoVMNGAhfYy7+oenwsyCmF/4cqDOPMrPB67vUloufT z4dw== X-Received: by 10.68.200.72 with SMTP id jq8mr37861188pbc.116.1409059812263; Tue, 26 Aug 2014 06:30:12 -0700 (PDT) Received: from [192.168.0.105] (014136185055.ctinets.com. [14.136.185.55]) by mx.google.com with ESMTPSA id x1sm3990580pdm.13.2014.08.26.06.30.10 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 26 Aug 2014 06:30:11 -0700 (PDT) Content-Type: multipart/alternative; boundary="Apple-Mail=_076436BA-CA35-4A70-8C36-71F7D3973498" Mime-Version: 1.0 (Mac OS X Mail 7.3 $1878.6$) Subject: Re: Compilation error: HBASE 0.98.4 with Snappy From: "Arthur.hk.chan@gmail.com" In-Reply-To: Date: Tue, 26 Aug 2014 21:30:07 +0800 Cc: "Arthur.hk.chan@gmail.com" Message-Id: <5F79FF83-75AF-4487-9CFA-FFBAA7B28C00@gmail.com> References:

<8560AAB1-0982-4AAD-8189-4D3FCFED4AA6@gmail.com> <9A2C4A3D-F64C-4017-AB9F-C74F70121C47@gmail.com> To: user@hbase.apache.org X-Mailer: Apple Mail (2.1878.6) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_076436BA-CA35-4A70-8C36-71F7D3973498 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi JM Below are my commands, tried two cases under same source code folder:=20 a) compile with snappy parameters(failed), =20 b) compile without snappy parameters (successful). Regards Arthur wget = http://mirrors.devlib.org/apache/hbase/stable/hbase-0.98.4-src.tar.gz tar -vxf hbase-0.98.4-src.tar.gz mv hbase-0.98.4 hbase-0.98.4-src_snappy cd hbase-0.98.4-src_snappy nano dev-support/generate-hadoopX-poms.sh (change hbase_home=3D=E2=80=9C/usr/local/hadoop/hbase-0.98.4-src_snappy= =E2=80=9D) bash -x ./dev-support/generate-hadoopX-poms.sh 0.98.4 0.98.4-hadoop2 a) with snappy parameters mvn -f pom.xml.hadoop2 install -DskipTests assembly:single = -Prelease,hadoop-snappy -Dhadoop-snappy.version=3D0.0.1-SNAPSHOT [INFO] = ------------------------------------------------------------------------ [INFO] Building HBase - Server 0.98.4-hadoop2 [INFO] = ------------------------------------------------------------------------ [WARNING] The POM for org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT = is missing, no dependency information available [INFO] = ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO]=20 [INFO] HBase ............................................. SUCCESS = [8.192s] [INFO] HBase - Common .................................... SUCCESS = [5.638s] [INFO] HBase - Protocol .................................. SUCCESS = [1.535s] [INFO] HBase - Client .................................... SUCCESS = [1.206s] [INFO] HBase - Hadoop Compatibility ...................... SUCCESS = [0.193s] [INFO] HBase - Hadoop Two Compatibility .................. SUCCESS = [0.798s] [INFO] HBase - Prefix Tree ............................... SUCCESS = [0.438s] [INFO] HBase - Server .................................... FAILURE = [0.234s] [INFO] HBase - Testing Util .............................. SKIPPED [INFO] HBase - Thrift .................................... SKIPPED [INFO] HBase - Shell ..................................... SKIPPED [INFO] HBase - Integration Tests ......................... SKIPPED [INFO] HBase - Examples .................................. SKIPPED [INFO] HBase - Assembly .................................. SKIPPED [INFO] = ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] = ------------------------------------------------------------------------ [INFO] Total time: 19.474s [INFO] Finished at: Tue Aug 26 21:21:13 HKT 2014 [INFO] Final Memory: 51M/1100M [INFO] = ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project hbase-server: Could not = resolve dependencies for project = org.apache.hbase:hbase-server:jar:0.98.4-hadoop2: Failure to find = org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT in = http://maven.oschina.net/content/groups/public/ was cached in the local = repository, resolution will not be reattempted until the update interval = of nexus-osc has elapsed or updates are forced -> [Help 1] [ERROR]=20 [ERROR] To see the full stack trace of the errors, re-run Maven with the = -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR]=20 [ERROR] For more information about the errors and possible solutions, = please read the following articles: [ERROR] [Help 1] = http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExcep= tion [ERROR]=20 [ERROR] After correcting the problems, you can resume the build with the = command [ERROR] mvn -rf :hbase-server b) try again, without snappy parameters mvn -f pom.xml.hadoop2 install -DskipTests assembly:single -Prelease [INFO] Building tar: = /edh/hadoop_all_sources/hbase-0.98.4-src_snappy/hbase-assembly/target/hbas= e-0.98.4-hadoop2-bin.tar.gz [INFO] = ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO]=20 [INFO] HBase ............................................. SUCCESS = [3.290s] [INFO] HBase - Common .................................... SUCCESS = [3.119s] [INFO] HBase - Protocol .................................. SUCCESS = [0.972s] [INFO] HBase - Client .................................... SUCCESS = [0.920s] [INFO] HBase - Hadoop Compatibility ...................... SUCCESS = [0.167s] [INFO] HBase - Hadoop Two Compatibility .................. SUCCESS = [0.504s] [INFO] HBase - Prefix Tree ............................... SUCCESS = [0.382s] [INFO] HBase - Server .................................... SUCCESS = [4.790s] [INFO] HBase - Testing Util .............................. SUCCESS = [0.598s] [INFO] HBase - Thrift .................................... SUCCESS = [1.536s] [INFO] HBase - Shell ..................................... SUCCESS = [0.369s] [INFO] HBase - Integration Tests ......................... SUCCESS = [0.443s] [INFO] HBase - Examples .................................. SUCCESS = [0.459s] [INFO] HBase - Assembly .................................. SUCCESS = [13.240s] [INFO] = ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] = ------------------------------------------------------------------------ [INFO] Total time: 31.408s [INFO] Finished at: Tue Aug 26 21:22:50 HKT 2014 [INFO] Final Memory: 57M/1627M [INFO] = ------------------------------------------------------------------------ On 26 Aug, 2014, at 8:52 pm, Jean-Marc Spaggiari = wrote: > Hi Arthur, >=20 > How have you extracted HBase source and what command do you run to = build? I > will do the same here locally so I can provide you the exact step to > complete. >=20 > JM >=20 >=20 > 2014-08-26 8:42 GMT-04:00 Arthur.hk.chan@gmail.com = > : >=20 >> Hi JM >>=20 >> Not too sure what you mean, do you mean I should create a new folder = in my >> HBASE_SRC named lib/native/Linux-x86 and copy these files to this = folder >> then try to compile it again? >>=20 >> Regards >> ARthur >>=20 >>=20 >> On 26 Aug, 2014, at 8:17 pm, Jean-Marc Spaggiari = >> wrote: >>=20 >>> Hi Arthur, >>>=20 >>> Almost done! You now need to copy them on the HBase folder. >>>=20 >>> hbase@hbasetest1:~/hbase-0.98.2-hadoop2/lib$ tree | grep -v .jar | = grep >> -v >>> .rb >>> . >>> =E2=94=9C=E2=94=80=E2=94=80 native >>> =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 Linux-x86 >>> =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 libsnappy.a >>> =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 libsnappy.la >>> =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 libsnappy.so >>> =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 libsnappy.so.1 >>> =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 libsnappy.so.1.2.0 >>>=20 >>> I don't have any hadoop-snappy lib in my hbase folder and it works = very >>> well with Snappy for me... >>>=20 >>> JM >>>=20 >>> 2014-08-26 8:09 GMT-04:00 Arthur.hk.chan@gmail.com < >> arthur.hk.chan@gmail.com >>>> : >>>=20 >>>> Hi JM, >>>>=20 >>>> Below are my steps to install snappy lib, do I miss something? >>>>=20 >>>> Regards >>>> Arthur >>>>=20 >>>> wget https://snappy.googlecode.com/files/snappy-1.1.1.tar.gz >>>> tar -vxf snappy-1.1.1.tar.gz >>>> cd snappy-1.1.1 >>>> ./configure >>>> make >>>> make install >>>> make[1]: Entering directory >> `/edh/hadoop_all_sources/snappy-1.1.1' >>>> test -z "/usr/local/lib" || /bin/mkdir -p "/usr/local/lib" >>>> /bin/sh ./libtool --mode=3Dinstall /usr/bin/install -c >>>> libsnappy.la '/usr/local/lib' >>>> libtool: install: /usr/bin/install -c = .libs/libsnappy.so.1.2.0 >>>> /usr/local/lib/libsnappy.so.1.2.0 >>>> libtool: install: (cd /usr/local/lib && { ln -s -f >>>> libsnappy.so.1.2.0 libsnappy.so.1 || { rm -f libsnappy.so.1 && ln = -s >>>> libsnappy.so.1.2.0 libsnappy.so.1; }; }) >>>> libtool: install: (cd /usr/local/lib && { ln -s -f >>>> libsnappy.so.1.2.0 libsnappy.so || { rm -f libsnappy.so && ln -s >>>> libsnappy.so.1.2.0 libsnappy.so; }; }) >>>> libtool: install: /usr/bin/install -c .libs/libsnappy.lai >>>> /usr/local/lib/libsnappy.la >>>> libtool: install: /usr/bin/install -c .libs/libsnappy.a >>>> /usr/local/lib/libsnappy.a >>>> libtool: install: chmod 644 /usr/local/lib/libsnappy.a >>>> libtool: install: ranlib /usr/local/lib/libsnappy.a >>>> libtool: finish: >>>>=20 >> = PATH=3D"/edh/hadoop/spark/bin:/edh/hadoop/hbase/bin:/edh/hadoop/zookeeper/= /bin:/edh/hadoop/yarn/hadoop/bin:/edh/hadoop/yarn/hadoop/sbin:/usr/lib64/q= t-3.3/bin:/opt/apache-maven-3.1.1/bin:/usr/local/sbin:/usr/local/bin:/sbin= :/bin:/usr/sbin:/usr/bin:/edh/hadoop/zookeeper//bin:/edh/hadoop/hive//bin:= /usr/lib/jvm/jdk1.6.0_45//bin:/root/bin:/sbin" >>>> ldconfig -n /usr/local/lib >>>>=20 >>>> = ---------------------------------------------------------------------- >>>> Libraries have been installed in: >>>> /usr/local/lib >>>> If you ever happen to want to link against installed = libraries >>>> in a given directory, LIBDIR, you must either use libtool, = and >>>> specify the full pathname of the library, or use the = `-LLIBDIR' >>>> flag during linking and do at least one of the following: >>>> - add LIBDIR to the `LD_LIBRARY_PATH' environment variable >>>> during execution >>>> - add LIBDIR to the `LD_RUN_PATH' environment variable >>>> during linking >>>> - use the `-Wl,-rpath -Wl,LIBDIR' linker flag >>>> - have your system administrator add LIBDIR to = `/etc/ld.so.conf' >>>> See any operating system documentation about shared libraries = for >>>> more information, such as the ld(1) and ld.so(8) manual = pages. >>>>=20 >>>> = ---------------------------------------------------------------------- >>>> test -z "/usr/local/share/doc/snappy" || /bin/mkdir -p >>>> "/usr/local/share/doc/snappy" >>>> /usr/bin/install -c -m 644 ChangeLog COPYING INSTALL NEWS = README >>>> format_description.txt framing_format.txt = '/usr/local/share/doc/snappy' >>>> test -z "/usr/local/include" || /bin/mkdir -p >> "/usr/local/include" >>>> /usr/bin/install -c -m 644 snappy.h snappy-sinksource.h >>>> snappy-stubs-public.h snappy-c.h '/usr/local/include' >>>> make[1]: Leaving directory = `/edh/hadoop_all_sources/snappy-1.1.1' >>>>=20 >>>> ll /usr/local/lib >>>> -rw-r--r--. 1 root root 233554 Aug 20 00:14 libsnappy.a >>>> -rwxr-xr-x. 1 root root 953 Aug 20 00:14 libsnappy.la >>>> lrwxrwxrwx. 1 root root 18 Aug 20 00:14 libsnappy.so -> >>>> libsnappy.so.1.2.0 >>>> lrwxrwxrwx. 1 root root 18 Aug 20 00:14 libsnappy.so.1 = -> >>>> libsnappy.so.1.2.0 >>>> -rwxr-xr-x. 1 root root 147726 Aug 20 00:14 = libsnappy.so.1.2.0 >>>>=20 >>>>=20 >>>>=20 >>>> On 26 Aug, 2014, at 7:38 pm, Jean-Marc Spaggiari < >> jean-marc@spaggiari.org> >>>> wrote: >>>>=20 >>>>> Hi Arthur, >>>>>=20 >>>>> Do you have snappy libs installed and configured? HBase doesn't = come >> with >>>>> Snappy. So yo need to have it first. >>>>>=20 >>>>> Shameless plug: >>>>>=20 >>>>=20 >> = http://www.spaggiari.org/index.php/hbase/how-to-install-snappy-with-1#.U_x= xSqdZuZY >>>>>=20 >>>>> This is for 0.96 but should be very similar for 0.98. I will try = it >> soon >>>>> and post and update, but keep us posted here so we can support = you... >>>>>=20 >>>>> JM >>>>>=20 >>>>>=20 >>>>> 2014-08-26 7:34 GMT-04:00 Arthur.hk.chan@gmail.com < >>>> arthur.hk.chan@gmail.com >>>>>> : >>>>>=20 >>>>>> Hi, >>>>>>=20 >>>>>> I need to install snappy to HBase 0.98.4. (my Hadoop version is >> 2.4.1) >>>>>>=20 >>>>>> Can you please advise what would be wrong? Should my pom.xml be >>>> incorrect >>>>>> and missing something? >>>>>>=20 >>>>>> Regards >>>>>> Arthur >>>>>>=20 >>>>>>=20 >>>>>> Below are my commands: >>>>>> bash -x ./dev-support/generate-hadoopX-poms.sh 0.98.4 = 0.98.4-hadoop2 >>>>>> mvn -f pom.xml.hadoop2 install -DskipTests assembly:single >>>>>> -Prelease,hadoop-snappy >>>>>>=20 >>>>>> Iog: >>>>>> [INFO] >>>>>>=20 >> = ------------------------------------------------------------------------ >>>>>> [INFO] Building HBase - Server 0.98.4-hadoop2 >>>>>> [INFO] >>>>>>=20 >> = ------------------------------------------------------------------------ >>>>>> [WARNING] The POM for >> org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT >>>>>> is missing, no dependency information available >>>>>> [INFO] >>>>>>=20 >> = ------------------------------------------------------------------------ >>>>>> [INFO] Reactor Summary: >>>>>> [INFO] >>>>>> [INFO] HBase ............................................. = SUCCESS >>>> [3.129s] >>>>>> [INFO] HBase - Common .................................... = SUCCESS >>>> [3.105s] >>>>>> [INFO] HBase - Protocol .................................. = SUCCESS >>>> [0.976s] >>>>>> [INFO] HBase - Client .................................... = SUCCESS >>>> [0.925s] >>>>>> [INFO] HBase - Hadoop Compatibility ...................... = SUCCESS >>>> [0.183s] >>>>>> [INFO] HBase - Hadoop Two Compatibility .................. = SUCCESS >>>> [0.497s] >>>>>> [INFO] HBase - Prefix Tree ............................... = SUCCESS >>>> [0.407s] >>>>>> [INFO] HBase - Server .................................... = FAILURE >>>> [0.103s] >>>>>> [INFO] HBase - Testing Util .............................. = SKIPPED >>>>>> [INFO] HBase - Thrift .................................... = SKIPPED >>>>>> [INFO] HBase - Shell ..................................... = SKIPPED >>>>>> [INFO] HBase - Integration Tests ......................... = SKIPPED >>>>>> [INFO] HBase - Examples .................................. = SKIPPED >>>>>> [INFO] HBase - Assembly .................................. = SKIPPED >>>>>> [INFO] >>>>>>=20 >> = ------------------------------------------------------------------------ >>>>>> [INFO] BUILD FAILURE >>>>>> [INFO] >>>>>>=20 >> = ------------------------------------------------------------------------ >>>>>> [INFO] Total time: 9.939s >>>>>> [INFO] Finished at: Tue Aug 26 19:23:14 HKT 2014 >>>>>> [INFO] Final Memory: 61M/2921M >>>>>> [INFO] >>>>>>=20 >> = ------------------------------------------------------------------------ >>>>>> [ERROR] Failed to execute goal on project hbase-server: Could not >>>> resolve >>>>>> dependencies for project >>>> org.apache.hbase:hbase-server:jar:0.98.4-hadoop2: >>>>>> Failure to find = org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT in >>>>>> http://maven.oschina.net/content/groups/public/ was cached in the >> local >>>>>> repository, resolution will not be reattempted until the update >>>> interval of >>>>>> nexus-osc has elapsed or updates are forced -> [Help 1] >>>>>> [ERROR] >>>>>> [ERROR] To see the full stack trace of the errors, re-run Maven = with >> the >>>>>> -e switch. >>>>>> [ERROR] Re-run Maven using the -X switch to enable full debug = logging. >>>>>> [ERROR] >>>>>> [ERROR] For more information about the errors and possible = solutions, >>>>>> please read the following articles: >>>>>> [ERROR] [Help 1] >>>>>>=20 >>>>=20 >> = http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExcep= tion >>>>>> [ERROR] >>>>>> [ERROR] After correcting the problems, you can resume the build = with >> the >>>>>> command >>>>>> [ERROR] mvn -rf :hbase-server >>>>>>=20 >>>>>>=20 >>>>=20 >>>>=20 >>=20 >>=20 --Apple-Mail=_076436BA-CA35-4A70-8C36-71F7D3973498--