hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: row_counter map reduce job & 0.90.1
Date Fri, 01 Apr 2011 16:40:34 GMT
I answered the same question under 'Row Counters' thread.
In short, you should use the following command:

[hadoop@us01-ciqps1-name01 hbase]$ HADOOP_CLASSPATH=`${HBASE_
HOME}/bin/hbase classpath` ${HADOOP_HOME}/bin/hadoop jar
${HBASE_HOME}/hbase-0.90.1.jar rowcounter packageindex


On Fri, Apr 1, 2011 at 9:26 AM, Venkatesh <vramanathan00@aol.com> wrote:

> Definitely yes..It'all referenced in -classpath option of jvm of
> tasktracker/jobtracker/datanode/namenode..
> & file does exist in the cluster..
>
> But the error I get is on the client
> File
> /home..../hdfs/tmp/mapred/system/job_201103311630_0027/libjars/hadoop-0.20.2-core.jar
> does not exist.
>    at
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
>    at
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
>    at
> org.apache.hadoop.filecache.DistributedCache.getTimestamp(DistributedCache.java:509)
>    at
> org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:629)
>    at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:761)
>    at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
>
> So, in theory in should n't expect from client ..correct?
>
> This is the only that is stopping me in moving to 0.90.1
>
>
>
>
>
>
>
>
>
>
> -----Original Message-----
> From: Stack <stack@duboce.net>
> To: user@hbase.apache.org
> Sent: Fri, Apr 1, 2011 12:19 pm
> Subject: Re: row_counter map reduce job & 0.90.1
>
>
> On Fri, Apr 1, 2011 at 9:06 AM, Venkatesh <vramanathan00@aol.com> wrote:
>
> >  I'm able to run this job from the hadoop machine (where job & task
> tracker
>
> also runs)
>
> > /hadoop jar /home/maryama/hbase-0.90.1/hbase-0.90.1.jar rowcounter
> <usertable>
>
> >
>
> > But, I'm not able to run the same job from
>
> > a) hbase client machine (full hbase & hadoop installed)
>
> > b) hbase server machines (ditto)
>
> >
>
> > Get
>
> > File
> /home/.../hdfs/tmp/mapred/system/job_201103311630_0024/libjars/hadoop-0.20.2-core.jar
>
> does not exist.
>
> >
>
>
>
> Is that jar present on the cluster?
>
> St.Ack
>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message