mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sanjib Kumar Das <sanjib....@gmail.com>
Subject Problem encountered while running RecommenderJob
Date Fri, 05 Nov 2010 20:57:05 GMT
Hi all,

I am trying to run the GroupLensRecommender on hadoop.
I am using the pseudo.RecommenderJob for that purpose.
Before running the command below i copied mahout-core-0.4-SNAPSHOT-job.jar
and renamed it to recommender.jar. I updated recommender.jar by adding
grouplens.jar to it.
Still I am getting the ClassNotFoundException for GroupLensRecommender. Am I
missing something?
Any help in this regard is highly appreciated.


hadoop jar recommender.jar
org.apache.mahout.cf.taste.hadoop.pseudo.RecommenderJob
-Dmapred.input.dir=testdata/ratings.csv -Dmapred.output.dir=output
--recommenderClassName
org.apache.mahout.cf.taste.example.grouplens.GroupLensRecommender
--numRecommendations 10

10/11/05 15:44:34 INFO common.AbstractJob: Command line arguments:
{--endPhase=2147483647, --numRecommendations=10,
--recommenderClassName=org.apache.mahout.cf.taste.example.grouplens.GroupLensRecommender,
--startPhase=0, --tempDir=temp}
10/11/05 15:44:34 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=
10/11/05 15:44:35 INFO input.FileInputFormat: Total input paths to process :
1
10/11/05 15:44:36 INFO mapred.JobClient: Running job: job_local_0001
10/11/05 15:44:36 INFO input.FileInputFormat: Total input paths to process :
1
10/11/05 15:44:36 INFO mapred.MapTask: io.sort.mb = 100
10/11/05 15:44:36 INFO mapred.MapTask: data buffer = 79691776/99614720
10/11/05 15:44:36 INFO mapred.MapTask: record buffer = 262144/327680
10/11/05 15:44:36 INFO mapred.MapTask: Spilling map output: record full =
true
10/11/05 15:44:36 INFO mapred.MapTask: bufstart = 0; bufend = 514677;
bufvoid = 99614720
10/11/05 15:44:36 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length =
327680
10/11/05 15:44:37 INFO mapred.JobClient:  map 0% reduce 0%
10/11/05 15:44:38 INFO util.NativeCodeLoader: Loaded the native-hadoop
library
10/11/05 15:44:38 INFO zlib.ZlibFactory: Successfully loaded & initialized
native-zlib library
10/11/05 15:44:38 INFO compress.CodecPool: Got brand-new compressor
10/11/05 15:44:39 INFO mapred.MapTask: Finished spill 0
10/11/05 15:44:39 INFO mapred.MapTask: Spilling map output: record full =
true
10/11/05 15:44:39 INFO mapred.MapTask: bufstart = 514677; bufend = 1038963;
bufvoid = 99614720
10/11/05 15:44:39 INFO mapred.MapTask: kvstart = 262144; kvend = 196607;
length = 327680
10/11/05 15:44:42 INFO mapred.LocalJobRunner:
10/11/05 15:44:42 INFO mapred.MapTask: Finished spill 1
10/11/05 15:44:42 INFO mapred.MapTask: Spilling map output: record full =
true
10/11/05 15:44:42 INFO mapred.MapTask: bufstart = 1038963; bufend = 1563249;
bufvoid = 99614720
10/11/05 15:44:42 INFO mapred.MapTask: kvstart = 196607; kvend = 131070;
length = 327680
10/11/05 15:44:43 INFO mapred.JobClient:  map 58% reduce 0%
10/11/05 15:44:44 INFO mapred.MapTask: Finished spill 2
10/11/05 15:44:45 INFO mapred.LocalJobRunner:
10/11/05 15:44:45 INFO mapred.MapTask: Starting flush of map output
10/11/05 15:44:46 INFO mapred.JobClient:  map 90% reduce 0%
10/11/05 15:44:47 INFO mapred.MapTask: Finished spill 3
10/11/05 15:44:47 INFO mapred.Merger: Merging 4 sorted segments
10/11/05 15:44:47 INFO compress.CodecPool: Got brand-new decompressor
10/11/05 15:44:47 INFO compress.CodecPool: Got brand-new decompressor
10/11/05 15:44:47 INFO compress.CodecPool: Got brand-new decompressor
10/11/05 15:44:47 INFO compress.CodecPool: Got brand-new decompressor
10/11/05 15:44:47 INFO mapred.Merger: Down to the last merge-pass, with 4
segments left of total size: 17968 bytes
10/11/05 15:44:48 INFO mapred.LocalJobRunner:
10/11/05 15:44:49 INFO mapred.JobClient:  map 100% reduce 0%
10/11/05 15:44:51 INFO mapred.LocalJobRunner:
10/11/05 15:44:52 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000000_0
is done. And is in the process of commiting
10/11/05 15:44:52 INFO mapred.LocalJobRunner:
10/11/05 15:44:52 INFO mapred.TaskRunner: Task
'attempt_local_0001_m_000000_0' done.
10/11/05 15:44:52 INFO mapred.LocalJobRunner:
10/11/05 15:44:52 INFO mapred.Merger: Merging 1 sorted segments
10/11/05 15:44:52 INFO mapred.Merger: Down to the last merge-pass, with 1
segments left of total size: 17813 bytes
10/11/05 15:44:52 INFO mapred.LocalJobRunner:
10/11/05 15:44:53 INFO file.FileDataModel: Creating FileDataModel for file
/tmp/mahout-taste-hadoop3533164687715963034txt
10/11/05 15:44:53 INFO file.FileDataModel: Reading file info...
10/11/05 15:44:58 INFO mapred.LocalJobRunner: reduce > reduce
10/11/05 15:44:59 INFO mapred.JobClient:  map 100% reduce 74%
10/11/05 15:45:08 INFO file.FileDataModel: Processed 1000000 lines
10/11/05 15:45:08 INFO file.FileDataModel: Read lines: 1000209
10/11/05 15:45:11 INFO model.GenericDataModel: Processed 6040 users
10/11/05 15:45:11 WARN mapred.LocalJobRunner: job_local_0001
java.lang.IllegalStateException: java.lang.ClassNotFoundException:
org.apache.mahout.cf.taste.example.grouplens.GroupLensRecommender

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message