hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From stack <st...@duboce.net>
Subject Re: Exception in rowcount program
Date Thu, 13 Aug 2009 14:55:41 GMT
On Thu, Aug 13, 2009 at 3:59 AM, velo0001 <velo0001@myid.me> wrote:

>
> I am running it in Eclipse on a windows machine client, going to a Linux
> machine where the Hadoop 0.20.0 DFS is deployed and the HBase 0.20.0 is
> deployed. I have used this WIN client machine for inserting row columns (up
> to a million rows with 3 columns each so far in my testing) and reading
> back
> existing row/columns, so I am relatively sure that all my conf setups on
> the
> windows client and the Linux server are correct. Everything else seems to
> run OK for me, except map reduce.
>

Inserting rows, client just needs to be configured properly.  Running a MR
job, participating classes must be available on the CLASSPATH on all nodes,
not just client.

My guess is that running from eclipse you were not fulfilling the latter
requirement.

Did you try running the rowcounter program from the command-line?

St.Ack


>
> Maybe map reduce processes are not designed to be run this way?
>
> And for the reply above yours, that package info is exactly what I used
> when
> setting things up. Look at my HADOOP_CLASSPATH export - it is what is shown
> in that information. And I have dbl checked the pathing and it is all
> correct for the Linux server that Hadoop and HBase are on.
>
> I am about to start playing with PIG, but I need to get map reduce working
> too.
>
> I will probably try copying the hbase-site.xml and hbase jar file into
> hadoop location, but like I said I really don't want that to be the answer.
>
> THx, for any help....
>
> _mc
>
>
>
> stack-3 wrote:
> >
> > How are you running it?
> >
> > $ ./bin/hadoop jar hbase.jar...
> >
> > .. or some other way?
> >
> > St.Ack
> >
> > On Wed, Aug 12, 2009 at 12:36 PM, velo0001 <velo0001@myid.me> wrote:
> >
> >>
> >>
> >>
> >> Erik Holstad wrote:
> >> >
> >> >>  you followed the instructions on
> >> > http://wiki.apache.org/hadoop/Hbase/MapReduce
> >> > and it didn't work for you?
> >> >
> >>
> >> I followed exactly the instructions given above. But I am getting the
> >> same
> >> type  of error for my map reduce, a class not found.
> >>
> >> (jar –tfv shows me that the ImmutableBytesWritable class does exist in
> >> the
> >> 0.20 hadoop jar - I am using 0.20 version)
> >>
> >> Here is my export in hadoop-env.sh:
> >>
> >> export
> >>
> >>
> HADOOP_CLASSPATH=/usr/hbase_install/hbase-0.20.0/hbase-0.20.0.jar:/usr/hbase_install/hbase-0.20.0/hbase-0.20.0-test.jar:/usr/hbase_install/hbase-0.20.0/hbase/conf
> >>
> >> (I could try copying the hadoop 0.20 jar and the hbase-site.xml into my
> >> hadoop conf dir, but I really don’t want to use that approach)
> >>
> >> Any ideas why I continue to get this error:
> >>
> >>
> >> DEBUG 14:53:49.536 main org.apache.hadoop.mapred.JobClient(776) -
> >> Creating
> >> splits at
> >> hdfs://
> >>
> devdkvstore.headquarters.socketware.com/tmp/hadoop-root/mapred/system/job_200908121217_0003/job.split
> >>  INFO 14:53:49.552 main org.apache.hadoop.mapred.FileInputFormat(192) -
> >> Total input paths to process : 1
> >> DEBUG 14:53:49.770 main org.apache.hadoop.mapred.FileInputFormat(248) -
> >> Total # of splits: 2
> >>  INFO 14:53:50.923 main org.apache.hadoop.mapred.JobClient(1278) -
> >> Running
> >> job: job_200908121217_0003
> >>  INFO 14:53:51.936 main org.apache.hadoop.mapred.JobClient(1291) -  map
> >> 0%
> >> reduce 0%
> >>  INFO 14:54:06.802 main org.apache.hadoop.mapred.JobClient(1320) - Task
> >> Id
> >> :
> >> attempt_200908121217_0003_m_000000_0, Status : FAILED
> >> java.lang.RuntimeException: java.lang.RuntimeException:
> >> java.lang.ClassNotFoundException:
> >> org.apache.hadoop.hbase.io.ImmutableBytesWritable
> >>        at
> >> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:840)
> >>        at
> >> org.apache.hadoop.mapred.JobConf.getMapOutputKeyClass(JobConf.java:590)
> >>        at
> >>
> org.apache.hadoop.mapred.JobConf.getOutputKeyComparator(JobConf.java:664)
> >>        at
> >>
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:689)
> >>        at
> org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:348)
> >>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> >>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
> >> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
> >> org.apache.hadoop.hbase.io.ImmutableBytesWritable
> >>        at
> >> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:808)
> >>        at
> >> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:832)
> >>        ... 6 more
> >> Caused by: java.lang.ClassNotFoundException:
> >> org.apache.hadoop.hbase.io.ImmutableBytesWritable
> >>        at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> >>        at java.security.AccessController.doPrivileged(Native Method)
> >>        at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> >>        at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> >>        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >>        at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> >>        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> >>        at java.lang.Class.forName0(Native Method)
> >>        at java.lang.Class.forName(Class.java:247)
> >>        at
> >>
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:761)
> >>        at
> >> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:806)
> >>        ... 7 more
> >>
> >>
> >>
> >> --
> >> View this message in context:
> >>
> http://www.nabble.com/Exception-in-rowcount-program-tp23195921p24943168.html
> >> Sent from the HBase User mailing list archive at Nabble.com.
> >>
> >>
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/Exception-in-rowcount-program-tp23195921p24952886.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message