Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of pat.ferrel@gmail.com
 designates 209.85.210.48 as permitted sender)
Content-Type: text/plain; charset=windows-1252
Mime-Version: 1.0 (Mac OS X Mail 6.0 \(1486\))
Subject: Error using hadoop in non-distributed mode
From: Pat Ferrel <pat.ferrel@gmail.com>
In-Reply-To: 
 <CAA2hHbd_v9+LOjaNAPo8Y-Xm2oPH0P0J=m3XWhrj4XNmrmBcAQ@mail.gmail.com>
Date: Sun, 2 Sep 2012 15:10:08 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <62F3AC2C-7D24-47A6-9FA4-415062F1D7C0@gmail.com>
References: <SNT142-W290FC7FC3D680DF1A45195E0BE0@phx.gbl>
 <CAA2hHbd_v9+LOjaNAPo8Y-Xm2oPH0P0J=m3XWhrj4XNmrmBcAQ@mail.gmail.com>
To: user@hadoop.apache.org

I'm using mahout with a local filesystem/non-hdfs config for debugging =
purposes. I'm running inside Intellij IDEA. When I run one particular =
part of the analysis I get the following error. I didn't write the code =
but we are looking for some hint about what might cause it. This job =
completes without error in a single node pseudo-clustered config but I =
can't use the debugger on it very easily.

several jobs in the pipeline complete without error creating part files =
just fine
=85.=20
12/09/02 14:56:29 INFO compress.CodecPool: Got brand-new decompressor
12/09/02 14:56:29 INFO compress.CodecPool: Got brand-new decompressor
12/09/02 14:56:29 INFO compress.CodecPool: Got brand-new decompressor
12/09/02 14:56:29 WARN mapred.LocalJobRunner: job_local_0002
java.io.FileNotFoundException: File =
/tmp/hadoop-pat/mapred/local/archive/-4686065962599733460_1587570556_15073=
8331/file/Users/pat/Projects/big-data/b/ssvd/Q-job/R-m-00000 does not =
exist.
	at =
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.j=
ava:371)
	at =
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:=
245)
	at =
org.apache.mahout.common.iterator.sequencefile.SequenceFileDirValueIterato=
r.<init>(SequenceFileDirValueIterator.java:92)
	at =
org.apache.mahout.math.hadoop.stochasticsvd.BtJob$BtMapper.setup(BtJob.jav=
a:219)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
	at =
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
	at =
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
Exception in thread "main" java.io.IOException: Bt job unsuccessful.
	at =
org.apache.mahout.math.hadoop.stochasticsvd.BtJob.run(BtJob.java:609)
	at =
org.apache.mahout.math.hadoop.stochasticsvd.SSVDSolver.run(SSVDSolver.java=
:397)
	at =
com.finderbots.analysis.AnalysisPipeline.SSVDTransformAndBack(AnalysisPipe=
line.java:257)
	at com.finderbots.analysis.AnalysisJob.run(AnalysisJob.java:20)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
	at com.finderbots.analysis.AnalysisJob.main(AnalysisJob.java:34)
Disconnected from the target VM, address: '127.0.0.1:63483', transport: =
'socket'

The file =
/tmp/hadoop-pat/mapred/local/archive/6590995089539988730_1587570556_371223=
31/file/Users/pat/Projects/big-data/b/ssvd/Q-job/R-m-00000

which is the subject of the error - does not exist

Users/pat/Projects/big-data/b/ssvd/Q-job/R-m-00000

does exist at the time of the error. So the code is looking for the data =
in the wrong place?