bigtop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Re: Start HBase build from BigTop
Date Wed, 20 Aug 2014 21:04:04 GMT
Ok. Found that the culprit jars (read only for root) have the same rights
on the build machine in .m2/repository/... So 2 options. At the build time
they need to be made a+r, or, at the deployment time they need to be made
a+r...

JM


2014-08-20 16:56 GMT-04:00 Jean-Marc Spaggiari <jean-marc@spaggiari.org>:

> Hi Cos,
>
> I think build is fine because I'm able to start HBase from the command
> line directly.
>
> I found one thing.
>
> -rw-------. 1 root root    82123 Aug 18 17:25 metrics-core-2.2.0.jar
>
> Some jars don't have the correct rights. That's one of the issues I faced.
>
> I fixed the java.lang.NoClassDefFoundError:
> org/apache/hadoop/http/HttpServer from the init.d script by exporting
> HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` before calling it.
>
> Now I have another exception on the HBase side but I'm very confortable to
> look at it:
> org.apache.hadoop.hbase.TableExistsException: hbase:namespace
>     at
> org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120)
>     at
> org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232)
>     at
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86)
>     at
> org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052)
>     at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915)
>     at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
>     at
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:263)
>     at java.lang.Thread.run(Thread.java:745)
>
> Did not have it when I run manually.
>
> I will continue and report when I found where it comes from..
>
> Thanks,
>
> JM
>
>
> 2014-08-20 16:41 GMT-04:00 Konstantin Boudnik <cos@apache.org>:
>
> Currently supported HBase if 0.98.2 (or 3???) and I was able personally to
>> setup a cluster from bigtop bits and run it. Furthermore, I was able to
>> do it
>> with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master
>> service
>> caveat.
>>
>> One of the possible reasons for the problem you see is merge of region and
>> master services. So, the master service is no longer relevant and needs
>> to be
>> removed (there's a ticket for it). Another one is the changes in the HBase
>> build process which needs to be reflected in Bigtop.
>>
>> Hope it helps,
>>   Cos
>>
>> On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote:
>> > Hi,
>> >
>> > I have no issues to build and start HBase from HBase code.
>> >
>> > But when I try from BigTop, at stratup I get a class not found error:
>> > [root@hbr101 ~]# /etc/init.d/hbase-master start
>> > starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out
>> > Exception in thread "main" java.lang.NoClassDefFoundError:
>> > org/apache/hadoop/http/HttpServer
>> >     at java.lang.ClassLoader.defineClass1(Native Method)
>> >     at java.lang.ClassLoader.defineClass(Unknown Source)
>> >     at java.security.SecureClassLoader.defineClass(Unknown Source)
>> >     at java.net.URLClassLoader.defineClass(Unknown Source)
>> >     at java.net.URLClassLoader.access$100(Unknown Source)
>> >     at java.net.URLClassLoader$1.run(Unknown Source)
>> >     at java.net.URLClassLoader$1.run(Unknown Source)
>> >     at java.security.AccessController.doPrivileged(Native Method)
>> >     at java.net.URLClassLoader.findClass(Unknown Source)
>> > Failed to start HBase master daemon. Return value: 1       [FAILED]
>> >
>> > If I export the Hadoop and HBase classpath, I'm able to pass this, but
>> the
>> > I face another ClassNotFound exception on the HBase side.
>> >
>> > export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
>> > [root@10-0-1-208 output]# /etc/init.d/hbase-master start
>> > starting master, logging to
>> /var/log/hbase/hbase-hbase-master-10-0-1-208.out
>> > Started HBase master daemon (hbase-master):                [  OK  ]
>> >
>> > 2014-08-20 19:29:37,788 INFO  [main] impl.MetricsSystemImpl: HBase
>> metrics
>> > system started
>> > 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master
>> > exiting
>> > java.lang.RuntimeException: Failed construction of Master: class
>> >
>> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
>> >     at
>> >
>> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
>> >     at
>> >
>> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
>> >     at
>> >
>> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
>> >     at
>> >
>> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
>> >     at
>> >
>> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
>> >     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>> >     at
>> >
>> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
>> >     at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
>> > Caused by: java.lang.NoClassDefFoundError:
>> com/yammer/metrics/stats/Sample
>> >     at
>> >
>> org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
>> >     at
>> >
>> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
>> >     at
>> >
>> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
>> >     at
>> >
>> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
>> >     at
>> >
>> org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
>> >     at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
>> >     at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
>> >     at
>> >
>> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
>> >     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>> Method)
>> >     at
>> >
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>> >     at
>> >
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>> >     at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>> >     at
>> >
>> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
>> >     ... 7 more
>> >
>> >
>> > I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk
>> and
>> > has been able to start it? I checked and class is on the metric jar, and
>> > the jar in there on the CP. so I'm wondering where this is coming from
>> and
>> > still investigating. If I found anything, I will open a JIRA and provide
>> > the details...
>> >
>> > Thanks,
>> >
>> > JM
>>
>
>

Mime
View raw message