bigtop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Konstantin Boudnik <...@apache.org>
Subject Re: Start HBase build from BigTop
Date Wed, 20 Aug 2014 21:10:57 GMT
On Wed, Aug 20, 2014 at 04:56PM, Jean-Marc Spaggiari wrote:
> Hi Cos,
> 
> I think build is fine because I'm able to start HBase from the command line
> directly.
> 
> I found one thing.
> 
> -rw-------. 1 root root    82123 Aug 18 17:25 metrics-core-2.2.0.jar
> 
> Some jars don't have the correct rights. That's one of the issues I faced.
> 
> I fixed the java.lang.NoClassDefFoundError:
> org/apache/hadoop/http/HttpServer from the init.d script by exporting
> HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` before calling it.

Which init script are you fixing? My point is that HBase 0.99 and later
doesn't have a master service anymore.  Hence, the init script might need be
just dropped. 

> Now I have another exception on the HBase side but I'm very confortable to
> look at it:
> org.apache.hadoop.hbase.TableExistsException: hbase:namespace
>     at
> org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120)
>     at
> org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232)
>     at
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86)
>     at
> org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052)
>     at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915)
>     at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603)
>     at
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:263)
>     at java.lang.Thread.run(Thread.java:745)
> 
> Did not have it when I run manually.
> 
> I will continue and report when I found where it comes from..
> 
> Thanks,
> 
> JM
> 
> 
> 2014-08-20 16:41 GMT-04:00 Konstantin Boudnik <cos@apache.org>:
> 
> > Currently supported HBase if 0.98.2 (or 3???) and I was able personally to
> > setup a cluster from bigtop bits and run it. Furthermore, I was able to do
> > it
> > with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master
> > service
> > caveat.
> >
> > One of the possible reasons for the problem you see is merge of region and
> > master services. So, the master service is no longer relevant and needs to
> > be
> > removed (there's a ticket for it). Another one is the changes in the HBase
> > build process which needs to be reflected in Bigtop.
> >
> > Hope it helps,
> >   Cos
> >
> > On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote:
> > > Hi,
> > >
> > > I have no issues to build and start HBase from HBase code.
> > >
> > > But when I try from BigTop, at stratup I get a class not found error:
> > > [root@hbr101 ~]# /etc/init.d/hbase-master start
> > > starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out
> > > Exception in thread "main" java.lang.NoClassDefFoundError:
> > > org/apache/hadoop/http/HttpServer
> > >     at java.lang.ClassLoader.defineClass1(Native Method)
> > >     at java.lang.ClassLoader.defineClass(Unknown Source)
> > >     at java.security.SecureClassLoader.defineClass(Unknown Source)
> > >     at java.net.URLClassLoader.defineClass(Unknown Source)
> > >     at java.net.URLClassLoader.access$100(Unknown Source)
> > >     at java.net.URLClassLoader$1.run(Unknown Source)
> > >     at java.net.URLClassLoader$1.run(Unknown Source)
> > >     at java.security.AccessController.doPrivileged(Native Method)
> > >     at java.net.URLClassLoader.findClass(Unknown Source)
> > > Failed to start HBase master daemon. Return value: 1       [FAILED]
> > >
> > > If I export the Hadoop and HBase classpath, I'm able to pass this, but
> > the
> > > I face another ClassNotFound exception on the HBase side.
> > >
> > > export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath`
> > > [root@10-0-1-208 output]# /etc/init.d/hbase-master start
> > > starting master, logging to
> > /var/log/hbase/hbase-hbase-master-10-0-1-208.out
> > > Started HBase master daemon (hbase-master):                [  OK  ]
> > >
> > > 2014-08-20 19:29:37,788 INFO  [main] impl.MetricsSystemImpl: HBase
> > metrics
> > > system started
> > > 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master
> > > exiting
> > > java.lang.RuntimeException: Failed construction of Master: class
> > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample
> > >     at
> > >
> > org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
> > >     at
> > >
> > org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202)
> > >     at
> > >
> > org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152)
> > >     at
> > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179)
> > >     at
> > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
> > >     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > >     at
> > >
> > org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
> > >     at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794)
> > > Caused by: java.lang.NoClassDefFoundError:
> > com/yammer/metrics/stats/Sample
> > >     at
> > >
> > org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271)
> > >     at
> > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65)
> > >     at
> > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48)
> > >     at
> > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38)
> > >     at
> > >
> > org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30)
> > >     at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878)
> > >     at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438)
> > >     at
> > >
> > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258)
> > >     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > Method)
> > >     at
> > >
> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > >     at
> > >
> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > >     at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > >     at
> > >
> > org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137)
> > >     ... 7 more
> > >
> > >
> > > I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk
> > and
> > > has been able to start it? I checked and class is on the metric jar, and
> > > the jar in there on the CP. so I'm wondering where this is coming from
> > and
> > > still investigating. If I found anything, I will open a JIRA and provide
> > > the details...
> > >
> > > Thanks,
> > >
> > > JM
> >

Mime
View raw message