hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gergely Novák (JIRA) <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5990) If output directory can not be created, error message on stdout does not provide any clue.
Date Mon, 11 Apr 2016 14:55:25 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235216#comment-15235216
] 

Gergely Novák commented on MAPREDUCE-5990:
------------------------------------------

It looks like your problem is not caused by the missing permissions but something else.

If I run the builtin wordcount with an output directory that the current user has no permission
to write to (/xy): {{bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1-SNAPSHOT.jar
wordcount input /xy/zz}} then I get {{java.io.IOException: Mkdirs failed to create file:/xy/zz/_temporary/0/_temporary/attempt_local731757024_0001_r_000000_0}}.

> If output directory can not be created, error message on stdout does not provide any
clue.
> ------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5990
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5990
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: examples
>            Reporter: Suhas Gogate
>              Labels: newbie
>
> In the following wordcount example output directory path can not be created because /temp
does not exists and user has not privileges to create output path at "/". 
> hadoop --config ./clustdir/ jar /homes/gogate/wordcount.jar com.XXXX.wordcount.WordCount
/in-path/gogate/myfile /temp/mywc-gogate 
> 09/04/28 23:00:32 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments.
Applications should implement Tool for the same.
> 09/04/28 23:00:32 INFO mapred.FileInputFormat: Total input paths to process : 1
> 09/04/28 23:00:32 INFO mapred.FileInputFormat: Total input paths to process : 1
> 09/04/28 23:00:33 INFO mapred.JobClient: Running job: job_200904282249_0004
> java.io.IOException: Job failed!
> 	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1113)
> 	at com.XXXX.wordcount.WordCount.main(WordCount.java:55)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
> 	at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> 	at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message