falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh Seetharam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-446) Hive Replications fail because of permissions issue
Date Tue, 27 May 2014 17:40:02 GMT

    [ https://issues.apache.org/jira/browse/FALCON-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14009942#comment-14009942
] 

Venkatesh Seetharam commented on FALCON-446:
--------------------------------------------

I do have a patch to move this to the logs dir which is setup with 777 perms. The good thing
is that the data is not visible to all but the user and hence secure. But, this introduces
an issue with log clean up service since this is not owned by falcon but the user and clean
up needs to move into the workflow post processing instead.

> Hive Replications fail because of permissions issue
> ---------------------------------------------------
>
>                 Key: FALCON-446
>                 URL: https://issues.apache.org/jira/browse/FALCON-446
>             Project: Falcon
>          Issue Type: Bug
>          Components: replication
>    Affects Versions: 0.5
>            Reporter: Venkatesh Seetharam
>
> {code}
> 3782 [main] INFO  org.apache.hadoop.hive.ql.exec.Task  - Copying data from file:/grid/0/hdp/yarn/local/usercache/hrt_qa/appcache/application_1400833228766_0501/container_1400833228766_0501_01_000002/tmp/yarn/hive_2014-05-23_12-29-47_090_1701018059611451226-1/-local-10000/_metadata
to hdfs://hor3n25.gq1.ygridcore.net:8020/projects/ivory/staging/FALCON_FEED_REPLICATION_raaw-logs16-f80d8f5d-406e-49f8-8e2b-4caa58e53639_corp-6ce8cdf0-ce74-40fd-9601-143971a93eb9/default/HCatReplication_oneSourceOneTarget_hyphen/dt=2010-01-01-20/2010-01-01-20-00/corp-2a555e7f-1c65-4ac0-b3ef-1edd2c7fdd4b/data
> 3800 [main] ERROR org.apache.hadoop.hive.ql.exec.Task  - Failed with exception Permission
denied: user=hrt_qa, access=WRITE, inode="/projects/ivory/staging":falcon:hdfs:drwxr-xr-x
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:251)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:232)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:176)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5509)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5491)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:5465)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:3608)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:3578)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3552)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:760)
> 	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:558)
> 	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
> 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
> 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557)
> 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message