Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates
 209.85.215.52 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAPQV63UW50syAhx6y+g8uLSC8R8jv6vQCWy01_B2UXz_q2Qarw@mail.gmail.com>
References: <1376550785757-4049278.post@n3.nabble.com>
	<CAPQV63UW50syAhx6y+g8uLSC8R8jv6vQCWy01_B2UXz_q2Qarw@mail.gmail.com>
Date: Thu, 15 Aug 2013 09:07:39 -0700
Message-ID: 
 <CALte62zQFx+=5mUx=dpuLNP0SRjELfgfSZ2FwMbC+3q_AkOtwQ@mail.gmail.com>
Subject: Re: Error Running MAP REDUCE Job
From: Ted Yu <yuzhihong@gmail.com>
To: "dev@hbase.apache.org" <dev@hbase.apache.org>
Content-Type: multipart/alternative; boundary=14dae93d970c5573c104e3feac72

--14dae93d970c5573c104e3feac72
Content-Type: text/plain; charset=ISO-8859-1

Nick:
Take a look at http://hbase.apache.org/book.html#tools.

See '15.1.1. Driver'

Cheers


On Thu, Aug 15, 2013 at 8:12 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Hi Nick,
>
> Are you really using hbase 0.94.0? We are at 0.94.10. .0 is a pretty old
> version. any chance to upgrade?
>
> Also, what is the output of this command?
> ls -hal /opt/hbase/
> ?
>
> Thanks,
>
> JM
>
> 2013/8/15 Nick <bnipun@gmail.com>
>
> > Hi
> >
> > I am trying to run a Standalone map reduce job but I am getting
> > ClassNotFoundException.
> > I am able to connect to shell and create tables, I am also able to scan
> > table from stand alone program
> > Not sure exactly where I am missing classpath setting
> > Will appreciate any advice.
> >
> > export
> >
> >
> HADOOP_CLASSPATH=/opt/hbase/bin:/opt/hbase/conf:/opt/hbase/hbase-0.94.0.jar:/opt/hbase/hbase-0.94.0-tests.jar
> >
> > /opt/hadoop/bin/hadoop -jar hbase-example-1.0.jar
> > client.MapperTesthuser@gmail.com
> >
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/hadoop/hbase/util/Bytes
> >         at client.MapperTest.<clinit>(MapperTest.java:29)
> > Caused by: java.lang.ClassNotFoundException:
> > org.apache.hadoop.hbase.util.Bytes
> >         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> >         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> >         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> >         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> >         ... 1 more
> >
> > My Program is like following
> >
> > package client;
> >
> >
> > import java.io.IOException;
> >
> >
> > import org.apache.hadoop.conf.Configuration;
> > import org.apache.hadoop.fs.Path;
> > import org.apache.hadoop.hbase.KeyValue;
> > import org.apache.hadoop.hbase.client.Result;
> > import org.apache.hadoop.hbase.client.Scan;
> > import org.apache.hadoop.hbase.io.ImmutableBytesWritable;
> > import org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil;
> > import org.apache.hadoop.hbase.mapreduce.TableMapper;
> > import org.apache.hadoop.hbase.util.Bytes;
> > import org.apache.hadoop.io.NullWritable;
> > import org.apache.hadoop.io.Text;
> > import org.apache.hadoop.mapreduce.Job;
> > import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
> > import org.apache.hadoop.mapreduce.lib.output.TextOutputFormat;
> >
> > import util.HBaseHelper;
> >
> > public class MapperTest {
> >
> >
> >         public static String TABLE = "30000001_registration";
> >         public static final String COOKIE_ID_QUAL_LABEL = "ci";
> >         public static final String REGISTRATION_ID_QUAL_LABEL = "r";
> >         public static final byte[] COOKIE_ID_QUAL =
> > Bytes.toBytes(COOKIE_ID_QUAL_LABEL);
> >         public static final byte[] REGISTRATION_ID_QUAL =
> > Bytes.toBytes(REGISTRATION_ID_QUAL_LABEL);
> >         public static final String NAME = "MapperTest";
> >
> >
> >           public static void main(String[] args) throws Exception {
> >
> >                 try{
> >                         Configuration conf = HBaseHelper.getProdQa();
> >                         Job job = new Job(conf, "Analyze data in " +
> > TABLE);
> >                     job.setJarByClass(MapperTest.class);
> >                     Scan scan = new Scan();
> >                     scan.setCaching(5);
> >                     scan.setCacheBlocks(false);
> >
> > TableMapReduceUtil.initTableMapperJob(TABLE.getBytes(), scan,
> > MyMapper.class,Text.class, NullWritable.class, job);
> >                     //job.setOutputKeyClass(Text.class);
> >                     //job.setOutputValueClass(NullWritable.class);
> >                     job.setNumReduceTasks(0);
> >                     FileOutputFormat.setOutputPath(job, new
> > Path("/tmp/nick"));
> >                     job.setOutputFormatClass(TextOutputFormat.class);
> >                     System.exit(job.waitForCompletion(true) ? 0 : 1);
> >                 }catch(Exception e){
> >                         System.out.println("There is something wrong");
> >                 }
> >
> >
> >         }
> >
> >         static class MyMapper extends TableMapper<Text, NullWritable>{
> >
> >                 @Override
> >                 protected void setup(Context context) throws IOException,
> >                                 InterruptedException {
> >                         System.out.println("Mapper called");
> >                 }
> >
> >                 @Override
> >                 protected void map(ImmutableBytesWritable key, Result
> > columns,
> >                                 Context context) throws IOException,
> > InterruptedException {
> >
> >                         Text text = new Text();
> >                 NullWritable nullVal = NullWritable.get();
> >
> >                     try {
> >                         for (KeyValue kv : columns.list()) {
> >
> >
> >
> if(Bytes.toString(kv.getQualifier()).equalsIgnoreCase(REGISTRATION_ID_QUAL_LABEL)){
> >
> > System.out.println(Bytes.toString(kv.getValue()));
> >                                         text.set(kv.getValue());
> >                                         context.write(text, nullVal);
> >                                 }
> >                         }
> >                     } catch (Exception e) {
> >                         System.out.println("There is something wrong");
> >                         e.printStackTrace();
> >                     }
> >                 }
> >
> >
> >
> >
> >
> >         }
> >
> >
> > }
> >
> >
> >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-hbase.679495.n3.nabble.com/Error-Running-MAP-REDUCE-Job-tp4049278.html
> > Sent from the HBase Developer mailing list archive at Nabble.com.
> >
>

--14dae93d970c5573c104e3feac72--