hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shumin Guo <gsmst...@gmail.com>
Subject Re: Strange error in Hadoop 2.2.0: FileNotFoundException: file:/tmp/hadoop-hadoop/mapred/
Date Wed, 23 Apr 2014 02:41:14 GMT
Can you list the file using hadoop commands? for example, hadoop fs -ls
...?



On Tue, Apr 22, 2014 at 10:32 AM, Natalia Connolly <
natalia.v.connolly@gmail.com> wrote:

> Hi Jay,
>
>    I am really not sure how to answer this question.   Here is the full
> error:
>
> 14/04/22 11:31:02 INFO mapred.LocalJobRunner: Map task executor complete.
> 14/04/22 11:31:02 WARN mapred.LocalJobRunner: job_local607122693_0003
> java.lang.Exception: java.lang.RuntimeException: Error in configuring
> object
> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:403)
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
>  at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:425)
>  at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:235)
>  at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>  at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>  at java.lang.Thread.run(Thread.java:724)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
>  ... 10 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
>  at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
>  at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38)
> ... 15 more
> Caused by: java.lang.reflect.InvocationTargetException
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
>  at
> org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
> ... 18 more
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
>  at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:60)
> at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:40)
>  at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.token.MapSelfJoin.configure(MapSelfJoin.java:98)
> ... 23 more
> Caused by: java.io.FileNotFoundException:
> file:/tmp/hadoop-hadoop/mapred/local/1398180662047/part-00000 (No such file
> or directory)
> at java.io.FileInputStream.open(Native Method)
>  at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at java.io.FileInputStream.<init>(FileInputStream.java:101)
>  at
> edu.uci.ics.fuzzyjoin.tokenorder.TokenLoad.loadTokenRank(TokenLoad.java:45)
> ... 25 more
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 running
> in uber mode : false
> 14/04/22 11:31:03 INFO mapreduce.Job:  map 0% reduce 0%
> 14/04/22 11:31:03 INFO mapreduce.Job: Job job_local607122693_0003 failed
> with state FAILED due to: NA
> 14/04/22 11:31:03 INFO mapreduce.Job: Counters: 0
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
> at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.run(FuzzyJoinDriver.java:179)
>  at
> edu.uci.ics.fuzzyjoin.hadoop.ridpairs.RIDPairsImproved.main(RIDPairsImproved.java:108)
> at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.bib(FuzzyJoin.java:39)
>  at edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoin.main(FuzzyJoin.java:86)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
>  at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
>  at
> edu.uci.ics.fuzzyjoin.hadoop.FuzzyJoinDriver.main(FuzzyJoinDriver.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>
>
>
> On Tue, Apr 22, 2014 at 11:25 AM, Jay Vyas <jayunit100@gmail.com> wrote:
>
>> Is this happening in the job client? or the mappers?
>>
>>
>> On Tue, Apr 22, 2014 at 11:21 AM, Natalia Connolly <
>> natalia.v.connolly@gmail.com> wrote:
>>
>>> Hello,
>>>
>>>   I am running Hadoop 2.2.0 in a single-node "cluster" mode.  My
>>> application dies with the following strange error:
>>>
>>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>>> file:/tmp/hadoop-hadoop/mapred/local/1398179594286/part-00000 (No such file
>>> or directory)
>>>
>>>    This looks like the kind of file that should have been created on the
>>> fly (and then deleted).  Does anyone know what this error is really a
>>> symptom of?  Perhaps some permissions issues?
>>>
>>>    Thank you,
>>>
>>>    Natalia
>>>
>>>
>>
>>
>> --
>> Jay Vyas
>> http://jayunit100.blogspot.com
>>
>
>

Mime
View raw message