From user-return-5188-apmail-mahout-user-archive=mahout.apache.org@mahout.apache.org Fri Nov 05 20:57:04 2010 Return-Path: Delivered-To: apmail-mahout-user-archive@www.apache.org Received: (qmail 10700 invoked from network); 5 Nov 2010 20:57:04 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 5 Nov 2010 20:57:04 -0000 Received: (qmail 32596 invoked by uid 500); 5 Nov 2010 20:57:34 -0000 Delivered-To: apmail-mahout-user-archive@mahout.apache.org Received: (qmail 32534 invoked by uid 500); 5 Nov 2010 20:57:34 -0000 Mailing-List: contact user-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@mahout.apache.org Delivered-To: mailing list user@mahout.apache.org Received: (qmail 32526 invoked by uid 99); 5 Nov 2010 20:57:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Nov 2010 20:57:33 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sanjib.kgp@gmail.com designates 74.125.82.50 as permitted sender) Received: from [74.125.82.50] (HELO mail-ww0-f50.google.com) (74.125.82.50) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Nov 2010 20:57:27 +0000 Received: by wwb17 with SMTP id 17so3659095wwb.7 for ; Fri, 05 Nov 2010 13:57:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=JRF+ny9jeDrmoKOySq9eTmXelECj7CUh4YJxJNlO4a0=; b=SOH7fkUGn7NJGggDPKHcFBm7zodtcuFqY3kg3CYoACIJN1+0Sy0wYPCC15vvi2Mfqs OAjnsay9SGWZHmkfQsYtp7vKUqO43bf3jRrdnIo/kH/oxUze9d4qYuWPEn7NHXfSFKPN sz6+t41qQ/5Z0d0MqJefyWE9GcNUPWInRqoKs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=Lv6FSQ7DSPAkRttRa5YF/zzoUXod40oOdUfs/uT/VbZzF+PjRrX0rWMy8Oz/XErpDL glWwXM1yv2XUg5XesPP0Tpn1e4Tf5ULHAHOOEMQ1/M3HIup7FvEJjKwQv2iMM762mW8P X2KmZ7GmL0vOxM7FFn29vT+eWKClagNjMOffQ= MIME-Version: 1.0 Received: by 10.216.231.82 with SMTP id k60mr1624396weq.88.1288990625720; Fri, 05 Nov 2010 13:57:05 -0700 (PDT) Received: by 10.216.68.74 with HTTP; Fri, 5 Nov 2010 13:57:05 -0700 (PDT) Date: Fri, 5 Nov 2010 15:57:05 -0500 Message-ID: Subject: Problem encountered while running RecommenderJob From: Sanjib Kumar Das To: user@mahout.apache.org Content-Type: multipart/alternative; boundary=000e0cd5c3265d67a4049454848d --000e0cd5c3265d67a4049454848d Content-Type: text/plain; charset=ISO-8859-1 Hi all, I am trying to run the GroupLensRecommender on hadoop. I am using the pseudo.RecommenderJob for that purpose. Before running the command below i copied mahout-core-0.4-SNAPSHOT-job.jar and renamed it to recommender.jar. I updated recommender.jar by adding grouplens.jar to it. Still I am getting the ClassNotFoundException for GroupLensRecommender. Am I missing something? Any help in this regard is highly appreciated. hadoop jar recommender.jar org.apache.mahout.cf.taste.hadoop.pseudo.RecommenderJob -Dmapred.input.dir=testdata/ratings.csv -Dmapred.output.dir=output --recommenderClassName org.apache.mahout.cf.taste.example.grouplens.GroupLensRecommender --numRecommendations 10 10/11/05 15:44:34 INFO common.AbstractJob: Command line arguments: {--endPhase=2147483647, --numRecommendations=10, --recommenderClassName=org.apache.mahout.cf.taste.example.grouplens.GroupLensRecommender, --startPhase=0, --tempDir=temp} 10/11/05 15:44:34 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 10/11/05 15:44:35 INFO input.FileInputFormat: Total input paths to process : 1 10/11/05 15:44:36 INFO mapred.JobClient: Running job: job_local_0001 10/11/05 15:44:36 INFO input.FileInputFormat: Total input paths to process : 1 10/11/05 15:44:36 INFO mapred.MapTask: io.sort.mb = 100 10/11/05 15:44:36 INFO mapred.MapTask: data buffer = 79691776/99614720 10/11/05 15:44:36 INFO mapred.MapTask: record buffer = 262144/327680 10/11/05 15:44:36 INFO mapred.MapTask: Spilling map output: record full = true 10/11/05 15:44:36 INFO mapred.MapTask: bufstart = 0; bufend = 514677; bufvoid = 99614720 10/11/05 15:44:36 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 10/11/05 15:44:37 INFO mapred.JobClient: map 0% reduce 0% 10/11/05 15:44:38 INFO util.NativeCodeLoader: Loaded the native-hadoop library 10/11/05 15:44:38 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 10/11/05 15:44:38 INFO compress.CodecPool: Got brand-new compressor 10/11/05 15:44:39 INFO mapred.MapTask: Finished spill 0 10/11/05 15:44:39 INFO mapred.MapTask: Spilling map output: record full = true 10/11/05 15:44:39 INFO mapred.MapTask: bufstart = 514677; bufend = 1038963; bufvoid = 99614720 10/11/05 15:44:39 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 10/11/05 15:44:42 INFO mapred.LocalJobRunner: 10/11/05 15:44:42 INFO mapred.MapTask: Finished spill 1 10/11/05 15:44:42 INFO mapred.MapTask: Spilling map output: record full = true 10/11/05 15:44:42 INFO mapred.MapTask: bufstart = 1038963; bufend = 1563249; bufvoid = 99614720 10/11/05 15:44:42 INFO mapred.MapTask: kvstart = 196607; kvend = 131070; length = 327680 10/11/05 15:44:43 INFO mapred.JobClient: map 58% reduce 0% 10/11/05 15:44:44 INFO mapred.MapTask: Finished spill 2 10/11/05 15:44:45 INFO mapred.LocalJobRunner: 10/11/05 15:44:45 INFO mapred.MapTask: Starting flush of map output 10/11/05 15:44:46 INFO mapred.JobClient: map 90% reduce 0% 10/11/05 15:44:47 INFO mapred.MapTask: Finished spill 3 10/11/05 15:44:47 INFO mapred.Merger: Merging 4 sorted segments 10/11/05 15:44:47 INFO compress.CodecPool: Got brand-new decompressor 10/11/05 15:44:47 INFO compress.CodecPool: Got brand-new decompressor 10/11/05 15:44:47 INFO compress.CodecPool: Got brand-new decompressor 10/11/05 15:44:47 INFO compress.CodecPool: Got brand-new decompressor 10/11/05 15:44:47 INFO mapred.Merger: Down to the last merge-pass, with 4 segments left of total size: 17968 bytes 10/11/05 15:44:48 INFO mapred.LocalJobRunner: 10/11/05 15:44:49 INFO mapred.JobClient: map 100% reduce 0% 10/11/05 15:44:51 INFO mapred.LocalJobRunner: 10/11/05 15:44:52 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting 10/11/05 15:44:52 INFO mapred.LocalJobRunner: 10/11/05 15:44:52 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000000_0' done. 10/11/05 15:44:52 INFO mapred.LocalJobRunner: 10/11/05 15:44:52 INFO mapred.Merger: Merging 1 sorted segments 10/11/05 15:44:52 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 17813 bytes 10/11/05 15:44:52 INFO mapred.LocalJobRunner: 10/11/05 15:44:53 INFO file.FileDataModel: Creating FileDataModel for file /tmp/mahout-taste-hadoop3533164687715963034txt 10/11/05 15:44:53 INFO file.FileDataModel: Reading file info... 10/11/05 15:44:58 INFO mapred.LocalJobRunner: reduce > reduce 10/11/05 15:44:59 INFO mapred.JobClient: map 100% reduce 74% 10/11/05 15:45:08 INFO file.FileDataModel: Processed 1000000 lines 10/11/05 15:45:08 INFO file.FileDataModel: Read lines: 1000209 10/11/05 15:45:11 INFO model.GenericDataModel: Processed 6040 users 10/11/05 15:45:11 WARN mapred.LocalJobRunner: job_local_0001 java.lang.IllegalStateException: java.lang.ClassNotFoundException: org.apache.mahout.cf.taste.example.grouplens.GroupLensRecommender --000e0cd5c3265d67a4049454848d--