hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andre Kelpe <ake...@concurrentinc.com>
Subject FSDownload, LocalFileSystem and DistributedCache permissions
Date Wed, 20 Aug 2014 15:48:57 GMT

I am trying to use the DistributedCache and I am running into problems in a
test, when using the LocalFileSystem. FSDownload complains about
permissions like so. This is hadoop 2.4.1 with JDK 6 on Linux.:

Caused by: java.io.IOException: Resource file:/path/to/some/file is not
publicly accessable and as such cannot be part of the public cache.
    at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:257)
    at org.apache.hadoop.yarn.util.FSDownload.access$000(FSDownload.java:60)
    at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:355)
    at org.apache.hadoop.yarn.util.FSDownload$2.run(FSDownload.java:353)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:352)
    at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:59)

I looked into the code and saw that there is an exception being made for
Windows and the LocalFileSystem:

I am wondering if this could be elevated to allow it in every case, where
the LocalFileSystem is used and if not, what sort of permissions I have to
set in my test, to make this work.


- André

André Kelpe

View raw message