hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Vyas <jayunit...@gmail.com>
Subject Re: Staging directory ENOTDIR error.
Date Fri, 12 Jul 2013 18:35:21 GMT
This was a very odd error - it turns out that i had created a file, called
"tmp" in my fs root directory, which meant that
when the jobs were trying to write to the tmp directory, they ran into the
not-a-dir exception.

In any case, I think the error reporting in NativeIO class should be
revised.

On Thu, Jul 11, 2013 at 10:24 PM, Devaraj k <devaraj.k@huawei.com> wrote:

>  Hi Jay,****
>
> ** **
>
>    Here client is trying to create a staging directory in local file
> system,  which actually should create in HDFS.****
>
> ** **
>
> Could you check whether do you have configured “fs.defaultFS”
> configuration in client with the HDFS.****
>
>     ****
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* Jay Vyas [mailto:jayunit100@gmail.com]
> *Sent:* 12 July 2013 04:12
> *To:* common-user@hadoop.apache.org
> *Subject:* Staging directory ENOTDIR error.****
>
> ** **
>
> Hi , I'm getting an ungoogleable exception, never seen this before. ****
>
> This is on a hadoop 1.1. cluster... It appears that its permissions
> related... ****
>
> Any thoughts as to how this could crop up?****
>
> I assume its a bug in my filesystem, but not sure.****
>
>
> 13/07/11 18:39:43 ERROR security.UserGroupInformation:
> PriviledgedActionException as:root cause:ENOTDIR: Not a directory
> ENOTDIR: Not a directory
>     at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method)
>     at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699)
>     at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654)
>     at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
>     at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
>     at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
>     at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
>
> ****
>
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com ****
>



-- 
Jay Vyas
http://jayunit100.blogspot.com

Mime
View raw message