hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sonal Goyal <sonalgoy...@gmail.com>
Subject Re: Trying to figure out possible causes of this exception
Date Wed, 07 Apr 2010 12:23:47 GMT
hi Kris,

Seems your program can not find the input file. Have you done a hadoop fs
-ls to verify that the file exists? Also, the path URL should be
hdfs://......


Thanks and Regards,
Sonal
www.meghsoft.com


On Wed, Apr 7, 2010 at 1:16 AM, Kris Nuttycombe
<kris.nuttycombe@gmail.com>wrote:

> Exception in thread "main" java.io.FileNotFoundException: File does
> not exist: hdfs:///test-batchEventLog/metrics/data
>        at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:457)
>        at
> org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:63)
>        at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
>        at
> org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
>        at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
>        at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
>        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
>        at reporting.HDFSMapReduceQuery.execute(HDFSMetricsQuery.scala:60)
>
> My job config contains the following:
>
>    println("using input path: " + inPath)
>    println("using output path: " + outPath)
>    FileInputFormat.setInputPaths(job, inPath);
>    FileOutputFormat.setOutputPath(job, outPath)
>
> with input & output paths printed out as:
>
> using input path: hdfs:/test-batchEventLog
> using output path:
> hdfs:/test-batchEventLog/out/03d24392-9bd9-4b23-8240-aceb54b3473c
>
> Any ideas why this would be occurring?
>
> Thanks,
>
> Kris
>

Mime
View raw message