Mailing-List: contact user-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@mahout.apache.org
Received-SPF: pass (athena.apache.org: domain of srowen@gmail.com designates
 74.125.83.42 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAFtBaTMgksqqvUOZbcxwx47AoJgeLygSnw0j41X6Sjn4a808zQ@mail.gmail.com>
References: 
 <CAFtBaTMLjyHWGpEvyrTcnew_LprLPzWsXm9gTY13kTc_y3Cevw@mail.gmail.com>
	<CAEccTyzhk2UWcq7AAE77CDi7c+EifVhQKaNf6_4LqYH17-D4Tw@mail.gmail.com>
	<CAFtBaTMgksqqvUOZbcxwx47AoJgeLygSnw0j41X6Sjn4a808zQ@mail.gmail.com>
Date: Wed, 10 Aug 2011 13:58:20 +0100
Message-ID: 
 <CAEccTyzk7Hjg-BLqEh=OJH2zHHHfcuN2Qv9Wy-JAYxjBfWccGA@mail.gmail.com>
Subject: Re: How to launch an Hadoop Recommender Job from Java ?
From: Sean Owen <srowen@gmail.com>
To: user@mahout.apache.org
Content-Type: multipart/alternative; boundary=001636c92a3f1bbfb004aa263cf6

--001636c92a3f1bbfb004aa263cf6
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

I don't believe it's actually cleaned out then. Hadoop thinks the temp
directory exists from a previous run, which perhaps failed. Make sure it is
deleted in HDFS. This is, at least, what the error is trying to tell you.
Are you running two jobs that might both want this directory?

2011/8/10 Cl=C3=A9ment Notin <clement.notin@gmail.com>

> Yes I agree it's ugly ;)
>
> I tried with the params
> "org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> -Dmapred.input.dir=3Dmb-recouser-input/input.csv
> -Dmapred.output.dir=3Dmb-recouser-output/reco.csv --numRecommendations 3
> --booleanData true --similarityClassname SIMILARITY_EUCLIDEAN_DISTANCE" (=
of
> course I split them).
>
> But I'm getting an error :
>  INFO [2011-08-10 14:52:05,195] (JobClient.java:871) - Cleaning up the
> staging area
>
> file:/tmp/hadoop-clement/mapred/staging/clement1957523084/.staging/job_lo=
cal_0001
> org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory
> temp/itemIDIndex already exists
>
> Even if I clean before the /tmp/hadoop-clement/ folder...
> And it don't seems to run on the cluster.
>
> 2011/8/10 Sean Owen <srowen@gmail.com>
>
> > You could just run the main() method with an array of the same argument=
s
> > you
> > passed on the command line. It's a little ugly but entirely works.
> >
> > 2011/8/10 Cl=C3=A9ment Notin <clement.notin@gmail.com>
> >
> > > Hello,
> > >
> > > I've achieved to run a recommender over hadoop using the command line
> > > /bin/mahout org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> --input
> > > .....
> > > I'm happy with it but now I want to launch this using Java.
> > >
> > > What is the easiest way to do this ? I tried to run the MahoutDriver
> but
> > it
> > > runs locally however I want to launch the job on an hadoop cluster.
> > >
> > > Regards.
> > >
> > > --
> > > *Cl=C3=A9ment **Notin*
> > >
> >
>
>
>
> --
> *Cl=C3=A9ment **Notin*
>

--001636c92a3f1bbfb004aa263cf6--