hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Re: Compilation error: HBASE 0.98.4 with Snappy
Date Tue, 26 Aug 2014 12:52:31 GMT
Hi Arthur,

How have you extracted HBase source and what command do you run to build? I
will do the same here locally so I can provide you the exact step to
complete.

JM


2014-08-26 8:42 GMT-04:00 Arthur.hk.chan@gmail.com <arthur.hk.chan@gmail.com
>:

> Hi JM
>
> Not too sure what you mean, do you mean I should create a new folder in my
> HBASE_SRC named lib/native/Linux-x86 and copy these files to this folder
> then try to compile it again?
>
> Regards
> ARthur
>
>
> On 26 Aug, 2014, at 8:17 pm, Jean-Marc Spaggiari <jean-marc@spaggiari.org>
> wrote:
>
> > Hi Arthur,
> >
> > Almost done! You now need to copy them on the HBase folder.
> >
> > hbase@hbasetest1:~/hbase-0.98.2-hadoop2/lib$ tree | grep -v .jar | grep
> -v
> > .rb
> > .
> > ├── native
> > │   └── Linux-x86
> > │       ├── libsnappy.a
> > │       ├── libsnappy.la
> > │       ├── libsnappy.so
> > │       ├── libsnappy.so.1
> > │       └── libsnappy.so.1.2.0
> >
> > I don't have any hadoop-snappy lib in my hbase folder and it works very
> > well with Snappy for me...
> >
> > JM
> >
> > 2014-08-26 8:09 GMT-04:00 Arthur.hk.chan@gmail.com <
> arthur.hk.chan@gmail.com
> >> :
> >
> >> Hi JM,
> >>
> >> Below are my steps to install snappy lib, do I miss something?
> >>
> >> Regards
> >> Arthur
> >>
> >> wget https://snappy.googlecode.com/files/snappy-1.1.1.tar.gz
> >> tar -vxf snappy-1.1.1.tar.gz
> >> cd snappy-1.1.1
> >> ./configure
> >> make
> >> make install
> >>        make[1]: Entering directory
> `/edh/hadoop_all_sources/snappy-1.1.1'
> >>        test -z "/usr/local/lib" || /bin/mkdir -p "/usr/local/lib"
> >>         /bin/sh ./libtool   --mode=install /usr/bin/install -c
> >> libsnappy.la '/usr/local/lib'
> >>        libtool: install: /usr/bin/install -c .libs/libsnappy.so.1.2.0
> >> /usr/local/lib/libsnappy.so.1.2.0
> >>        libtool: install: (cd /usr/local/lib && { ln -s -f
> >> libsnappy.so.1.2.0 libsnappy.so.1 || { rm -f libsnappy.so.1 && ln -s
> >> libsnappy.so.1.2.0 libsnappy.so.1; }; })
> >>        libtool: install: (cd /usr/local/lib && { ln -s -f
> >> libsnappy.so.1.2.0 libsnappy.so || { rm -f libsnappy.so && ln -s
> >> libsnappy.so.1.2.0 libsnappy.so; }; })
> >>        libtool: install: /usr/bin/install -c .libs/libsnappy.lai
> >> /usr/local/lib/libsnappy.la
> >>        libtool: install: /usr/bin/install -c .libs/libsnappy.a
> >> /usr/local/lib/libsnappy.a
> >>        libtool: install: chmod 644 /usr/local/lib/libsnappy.a
> >>        libtool: install: ranlib /usr/local/lib/libsnappy.a
> >>        libtool: finish:
> >>
> PATH="/edh/hadoop/spark/bin:/edh/hadoop/hbase/bin:/edh/hadoop/zookeeper//bin:/edh/hadoop/yarn/hadoop/bin:/edh/hadoop/yarn/hadoop/sbin:/usr/lib64/qt-3.3/bin:/opt/apache-maven-3.1.1/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/edh/hadoop/zookeeper//bin:/edh/hadoop/hive//bin:/usr/lib/jvm/jdk1.6.0_45//bin:/root/bin:/sbin"
> >> ldconfig -n /usr/local/lib
> >>
> >> ----------------------------------------------------------------------
> >>        Libraries have been installed in:
> >>        /usr/local/lib
> >>        If you ever happen to want to link against installed libraries
> >>        in a given directory, LIBDIR, you must either use libtool, and
> >>        specify the full pathname of the library, or use the `-LLIBDIR'
> >>        flag during linking and do at least one of the following:
> >>        - add LIBDIR to the `LD_LIBRARY_PATH' environment variable
> >>        during execution
> >>        - add LIBDIR to the `LD_RUN_PATH' environment variable
> >>        during linking
> >>        - use the `-Wl,-rpath -Wl,LIBDIR' linker flag
> >>        - have your system administrator add LIBDIR to `/etc/ld.so.conf'
> >>        See any operating system documentation about shared libraries for
> >>        more information, such as the ld(1) and ld.so(8) manual pages.
> >>
> >> ----------------------------------------------------------------------
> >>        test -z "/usr/local/share/doc/snappy" || /bin/mkdir -p
> >> "/usr/local/share/doc/snappy"
> >>         /usr/bin/install -c -m 644 ChangeLog COPYING INSTALL NEWS README
> >> format_description.txt framing_format.txt '/usr/local/share/doc/snappy'
> >>        test -z "/usr/local/include" || /bin/mkdir -p
> "/usr/local/include"
> >>         /usr/bin/install -c -m 644 snappy.h snappy-sinksource.h
> >> snappy-stubs-public.h snappy-c.h '/usr/local/include'
> >>        make[1]: Leaving directory `/edh/hadoop_all_sources/snappy-1.1.1'
> >>
> >> ll /usr/local/lib
> >>        -rw-r--r--. 1 root root   233554 Aug 20 00:14 libsnappy.a
> >>        -rwxr-xr-x. 1 root root      953 Aug 20 00:14 libsnappy.la
> >>        lrwxrwxrwx. 1 root root       18 Aug 20 00:14 libsnappy.so ->
> >> libsnappy.so.1.2.0
> >>        lrwxrwxrwx. 1 root root       18 Aug 20 00:14 libsnappy.so.1 ->
> >> libsnappy.so.1.2.0
> >>        -rwxr-xr-x. 1 root root   147726 Aug 20 00:14 libsnappy.so.1.2.0
> >>
> >>
> >>
> >> On 26 Aug, 2014, at 7:38 pm, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org>
> >> wrote:
> >>
> >>> Hi Arthur,
> >>>
> >>> Do you have snappy libs installed and configured? HBase doesn't come
> with
> >>> Snappy. So yo need to have it first.
> >>>
> >>> Shameless plug:
> >>>
> >>
> http://www.spaggiari.org/index.php/hbase/how-to-install-snappy-with-1#.U_xxSqdZuZY
> >>>
> >>> This is for 0.96 but should be very similar for 0.98. I will try it
> soon
> >>> and post and update, but keep us posted here so we can support you...
> >>>
> >>> JM
> >>>
> >>>
> >>> 2014-08-26 7:34 GMT-04:00 Arthur.hk.chan@gmail.com <
> >> arthur.hk.chan@gmail.com
> >>>> :
> >>>
> >>>> Hi,
> >>>>
> >>>> I need to install snappy to HBase 0.98.4.  (my Hadoop version is
> 2.4.1)
> >>>>
> >>>> Can you please advise what would be wrong?  Should my pom.xml be
> >> incorrect
> >>>> and missing something?
> >>>>
> >>>> Regards
> >>>> Arthur
> >>>>
> >>>>
> >>>> Below are my commands:
> >>>> bash -x ./dev-support/generate-hadoopX-poms.sh 0.98.4 0.98.4-hadoop2
> >>>> mvn -f pom.xml.hadoop2 install -DskipTests assembly:single
> >>>> -Prelease,hadoop-snappy
> >>>>
> >>>> Iog:
> >>>> [INFO]
> >>>>
> ------------------------------------------------------------------------
> >>>> [INFO] Building HBase - Server 0.98.4-hadoop2
> >>>> [INFO]
> >>>>
> ------------------------------------------------------------------------
> >>>> [WARNING] The POM for
> org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT
> >>>> is missing, no dependency information available
> >>>> [INFO]
> >>>>
> ------------------------------------------------------------------------
> >>>> [INFO] Reactor Summary:
> >>>> [INFO]
> >>>> [INFO] HBase ............................................. SUCCESS
> >> [3.129s]
> >>>> [INFO] HBase - Common .................................... SUCCESS
> >> [3.105s]
> >>>> [INFO] HBase - Protocol .................................. SUCCESS
> >> [0.976s]
> >>>> [INFO] HBase - Client .................................... SUCCESS
> >> [0.925s]
> >>>> [INFO] HBase - Hadoop Compatibility ...................... SUCCESS
> >> [0.183s]
> >>>> [INFO] HBase - Hadoop Two Compatibility .................. SUCCESS
> >> [0.497s]
> >>>> [INFO] HBase - Prefix Tree ............................... SUCCESS
> >> [0.407s]
> >>>> [INFO] HBase - Server .................................... FAILURE
> >> [0.103s]
> >>>> [INFO] HBase - Testing Util .............................. SKIPPED
> >>>> [INFO] HBase - Thrift .................................... SKIPPED
> >>>> [INFO] HBase - Shell ..................................... SKIPPED
> >>>> [INFO] HBase - Integration Tests ......................... SKIPPED
> >>>> [INFO] HBase - Examples .................................. SKIPPED
> >>>> [INFO] HBase - Assembly .................................. SKIPPED
> >>>> [INFO]
> >>>>
> ------------------------------------------------------------------------
> >>>> [INFO] BUILD FAILURE
> >>>> [INFO]
> >>>>
> ------------------------------------------------------------------------
> >>>> [INFO] Total time: 9.939s
> >>>> [INFO] Finished at: Tue Aug 26 19:23:14 HKT 2014
> >>>> [INFO] Final Memory: 61M/2921M
> >>>> [INFO]
> >>>>
> ------------------------------------------------------------------------
> >>>> [ERROR] Failed to execute goal on project hbase-server: Could not
> >> resolve
> >>>> dependencies for project
> >> org.apache.hbase:hbase-server:jar:0.98.4-hadoop2:
> >>>> Failure to find org.apache.hadoop:hadoop-snappy:jar:0.0.1-SNAPSHOT in
> >>>> http://maven.oschina.net/content/groups/public/ was cached in the
> local
> >>>> repository, resolution will not be reattempted until the update
> >> interval of
> >>>> nexus-osc has elapsed or updates are forced -> [Help 1]
> >>>> [ERROR]
> >>>> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the
> >>>> -e switch.
> >>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>>> [ERROR]
> >>>> [ERROR] For more information about the errors and possible solutions,
> >>>> please read the following articles:
> >>>> [ERROR] [Help 1]
> >>>>
> >>
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> >>>> [ERROR]
> >>>> [ERROR] After correcting the problems, you can resume the build with
> the
> >>>> command
> >>>> [ERROR]   mvn <goals> -rf :hbase-server
> >>>>
> >>>>
> >>
> >>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message