hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bharath Vissapragada <bhara...@cloudera.com>
Subject Re: HBase looks for hadoop-common.jar in Hdfs
Date Fri, 07 Mar 2014 02:40:34 GMT
With 2.2.0, default mr engine is yarn, but I believe your job is being
submitted to local mrv1. Just add the following to the mapred-site.xml and
see if that works,

<property>
             <name>mapreduce.framework.name</name>
              <value>yarn</value>
    </property>



On Fri, Mar 7, 2014 at 7:38 AM, Reza <reza.nouri@outlook.com> wrote:

> I am trying to run a hadoop(version:2.2.0) job on a single machine which
> writes the reducer output into a Hbase(version 0.98) table. When I run the
> job, HBase looks for hadoop-common.jar file in the HDFS:
>
> 2014-03-07 10:52:44,499 ERROR [main] security.UserGroupInformation
> (UserGroupInformation.java:doAs(1494)) - PriviledgedActionException
> as:ubuntu (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not
> exist: hdfs://127.0.0.1:9000/home/ubuntu/workspace/XXXX/lib/hadoop-common-
> 2.2.0.jar
>
> Here is my job configuration:
>
> Configuration conf = HBaseConfiguration.create();
> conf.set("hbase.zookeeper.quorum", "127.0.0.1");
> Job job = Job.getInstance(conf, "CreateLookUpTable");
> job.setJarByClass(HBaseLookUp.class);
> // configure output and input source
> N3TextInputFormat.addInputPath(job, new Path(inputText));
> job.setInputFormatClass(N3InputFormat.class);
> // configure mapper and reducer
> job.setMapperClass(HBaseLookUp.Map.class);
> // configure output
> TableMapReduceUtil.initTableReducerJob("LookUp", HBaseLookUp.Red.class,
> job);
> job.setMapOutputKeyClass(Text.class);
> job.setMapOutputValueClass(Text.class);
> job.setReducerClass(HBaseLookUp.Red.class);
>
> job.setOutputKeyClass(Text.class);
> job.setOutputValueClass(NullWritable.class);
>
>
> Any idea about this issue?
>
>


-- 
Bharath Vissapragada
<http://www.cloudera.com>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message