mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajpal, Harjeet Kumar" <Harjeet.Ku...@Honeywell.com>
Subject RE: Mahout on Hadoop
Date Mon, 30 Nov 2009 08:30:09 GMT
Hi,
I tried with Hadoop 0.19.2 also
Error is again following

$ bin/hadoop jar mahout-examples-0.2-SNAPSHOT.job org.apache.mahout.cf.taste.hadoop.RecommenderJob
org.apache.mahout.cf.taste.impl.recommender.slopeone.SlopeOneRecommenderTest 10 InputD/data1.txt
In
putD/data2.txt true
java.lang.NoSuchMethodError: org.apache.hadoop.mapred.JobConf.setBooleanIfUnset(Ljava/lang/String;Z)
V
        at org.apache.hadoop.mapreduce.Job.setUseNewAPI(Job.java:388)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:431)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
        at org.apache.mahout.cf.taste.hadoop.RecommenderJob.main(RecommenderJob.java:66)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
        at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68) 

-----Original Message-----
From: Rajpal, Harjeet Kumar [mailto:Harjeet.Kumar@Honeywell.com] 
Sent: Monday, November 30, 2009 12:35 PM
To: mahout-user@lucene.apache.org
Subject: RE: Mahout on Hadoop


Hi,
Thanks for reply.
I tried mahout with Hadoop 0.18.3 now following error occurs

Command is: 
HadoopAdmin@IE11DTXPJ9K2C1S ~/hadoop-0.18.3
$ bin/hadoop jar mahout-examples-0.2-SNAPSHOT.job org.apache.mahout.cf.taste.hadoop.RecommenderJob
org.apache.mahout.cf.taste.impl.recommender.slopeone.SlopeOneRecommenderTest 10 InputD/data1.txt
InputD/data2.txt true

ERROR is : 
java.lang.NoSuchMethodError: org.apache.hadoop.mapred.JobConf.setBooleanIfUnset(Ljava/lang/String;Z)
V
        at org.apache.hadoop.mapreduce.Job.setUseNewAPI(Job.java:388)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:431)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
        at org.apache.mahout.cf.taste.hadoop.RecommenderJob.main(RecommenderJob.java:66)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
        at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)

I hope it will clarify more on what is problem.
Thanks and regards,
Harjeet Kumar Rajpal


-----Original Message-----
From: Sean Owen [mailto:srowen@gmail.com] 
Sent: Saturday, November 28, 2009 5:13 PM
To: mahout-user@lucene.apache.org
Subject: Re: Mahout on Hadoop

Yeah, this is an issue with Hadoop. You can see that when using the
new API, it's still looking for the old interfaces
(org.apache.hadoop.mapred.OutputFormat). I have also been waiting for
Hadoop to fix this.

On Sat, Nov 28, 2009 at 11:16 AM, Rajpal, Harjeet Kumar
<Harjeet.Kumar@honeywell.com> wrote:
> Hi,
>
>  I am a newbie to Hadoop and Mahout. I have configured Hadoop on my
> machine and tried to run mahout on this.
>
> I tried following command.
>
> $ bin/hadoop jar mahout-core-0.2-SNAPSHOT.job
> org.apache.mahout.cf.taste.hadoop.RecommenderJob org.
>
> apache.mahout.cf.taste.impl.recommender.slopeone.SlopeOneRecommenderTest
> 10 InputD/data1.txt InputD
>
> /data2.txt true
>
>
>
> I got following error message:
>
>
>
> 09/11/28 16:22:25 WARN conf.Configuration: DEPRECATED: hadoop-site.xml
> found in the classpath. Usage of hadoop-site.xml is deprecated. Instead
> use core-site.xml, mapred-site.xml and hdfs-site.xml to override
> properties of core-default.xml, mapred-default.xml and hdfs-default.xml
> respectively
>
> 09/11/28 16:22:25 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the same.
>
> Exception in thread "main" java.lang.RuntimeException:
> java.lang.RuntimeException: class
> org.apache.hadoop.mapreduce.lib.output.TextOutputFormat not
> org.apache.hadoop.mapred.OutputFormat
>
>      at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:840)
>
>      at
> org.apache.hadoop.mapred.JobConf.getOutputFormat(JobConf.java:488)
>
>      at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:772)
>
>      at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
>
>      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
>
>      at
> org.apache.mahout.cf.taste.hadoop.RecommenderJob.main(RecommenderJob.jav
> a:66)
>
> Caused by: java.lang.RuntimeException: class
> org.apache.hadoop.mapreduce.lib.output.TextOutputFormat not
> org.apache.hadoop.mapred.OutputFormat
>
>      at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:834)
>
>      ... 5 more
>
> Can anybody tell How to resolve this.
>
> Thanks in advance
>
>
>
> Best Regards,
>
> Harjeet Kumar Rajpal
>
>
>
>

Mime
View raw message