hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From AnandaVelMurugan Chandra Mohan <ananthu2...@gmail.com>
Subject Re: Need help in running rowcounter mapreduce job in Hadoop cluster
Date Wed, 13 Jun 2012 08:56:24 GMT
Thanks everyone!!!! It worked. But interestingly it takes more time to
count few rows. Any idea?


On Wed, Jun 13, 2012 at 12:53 PM, Gopinathan A <gopinathan.a@huawei.com>wrote:

> Please ensure hbase-*.jar, Guava-r*.jar, protobuf-*.jar & zookeeper.jar  in
> your classpath.
>
>
> >export
> > HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/usr/local/hbase-0.92.1-security/lib/
>
> This will not add all the jars into the classpath. You have to iterate the
> lib folder and then you have to add to HADOOP_CLASSPATH. You can copy all
> the above jars into the hadoop lib directly, if ur not able to do this.
>
>
> Thanks & Regards,
> Gopinathan A
>
>
> ****************************************************************************
> ***********
> This e-mail and attachments contain confidential information from HUAWEI,
> which is intended only for the person or entity whose address is listed
> above. Any use of the information contained herein in any way (including,
> but not limited to, total or partial disclosure, reproduction, or
> dissemination) by persons other than the intended recipient's) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by
> phone or email immediately and delete it!
>
>
> -----Original Message-----
> From: AnandaVelMurugan Chandra Mohan [mailto:ananthu2050@gmail.com]
> Sent: Wednesday, June 13, 2012 12:17 PM
> To: user@hbase.apache.org
> Subject: Re: Need help in running rowcounter mapreduce job in Hadoop
> cluster
>
> Thanks for quick response
>
> That was a silly mistake. Sorry about that. But now I get the following
> error
>
> Exception in thread "main" java.lang.NoClassDefFoundError:
> com/google/common/collect/Multimap
>        at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:43)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57
> )
>        at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
> .java:43)
>        at java.lang.reflect.Method.invoke(Method.java:616)
>        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Caused by: java.lang.ClassNotFoundException:
> com.google.common.collect.Multimap
>        at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
>        ... 6 more
>
> I think this is because the jars in <HBase home>/lib folder are not in
> hadoop classpath. But I have explicitly set it already. Am I missing
> anything still?
>
>
>
> On Wed, Jun 13, 2012 at 11:48 AM, Gopinathan A
> <gopinathan.a@huawei.com>wrote:
>
> > Use ./hadoop jar
> /usr/local/hbase-0.92.1-security/hbase-0.92.1-security.jar
> > rowcounter <tablename>
> >
> > Thanks & Regards,
> > Gopinathan A
> >
> >
> >
>
> ****************************************************************************
> > ***********
> > This e-mail and attachments contain confidential information from HUAWEI,
> > which is intended only for the person or entity whose address is listed
> > above. Any use of the information contained herein in any way (including,
> > but not limited to, total or partial disclosure, reproduction, or
> > dissemination) by persons other than the intended recipient's) is
> > prohibited. If you receive this e-mail in error, please notify the sender
> > by
> > phone or email immediately and delete it!
> >
> > -----Original Message-----
> > From: AnandaVelMurugan Chandra Mohan [mailto:ananthu2050@gmail.com]
> > Sent: Wednesday, June 13, 2012 10:52 AM
> > To: user@hbase.apache.org
> > Subject: Need help in running rowcounter mapreduce job in Hadoop cluster
> >
> > Hi,
> >
> > I have a three node Hadoop fully distributed cluster. I have HBase
> > installed, also in fully distributed mode. I am interested in running
> > rowcounter map reduce job bundled with HBase.
> >
> > I am doing the following in one of my node
> >
> >
> > export
> > HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/usr/local/hbase-0.92.1-security/lib/
> > export
> > HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/usr/local/hbase-0.92.1-security/conf/
> > cd /usr/local/hadoop-1.0.2/bin/
> > ./hadoop /usr/local/hbase-0.92.1-security/hbase-0.92.1-security.jar
> > rowcounter <tablename>
> >
> > I am getting following error
> >
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > /usr/local/hbase-0/92
> > /1-security/hbase-0/92/1-security/jar
> > Caused by: java.lang.ClassNotFoundException:
> > .usr.local.hbase-0.92.1-security.hb
> > ase-0.92.1-security.jar
> >        at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
> >        at java.security.AccessController.doPrivileged(Native Method)
> >        at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
> >        at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
> >        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
> >        at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
> > Could not find the main class:
> > /usr/local/hbase-0.92.1-security/hbase-0.92.1-sec
> > urity.jar. Program will exit.
> >
> > Am I doing anything wrong. Should I change any configuration file in
> > Hadoop.
> >
> > Any help would be greatly appreciated.
> >
> > --
> > Regards,
> > Anand
> >
> >
>
>
> --
> Regards,
> Anand
>
>


-- 
Regards,
Anand

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message