falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh Seetharam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-446) Hive Replications fail because of permissions issue
Date Wed, 09 Jul 2014 13:49:04 GMT

    [ https://issues.apache.org/jira/browse/FALCON-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056241#comment-14056241
] 

Venkatesh Seetharam commented on FALCON-446:
--------------------------------------------

bq. The idea of pre-processing and post-processing is so that we can combine all falcon related
logic inside these instead of having multiple actions for each step
Agreed, but its quite generic today with out being aware of what the lifecycle is. In this
case, you will introduce a replication specific logic which is not desirable. 

> Hive Replications fail because of permissions issue
> ---------------------------------------------------
>
>                 Key: FALCON-446
>                 URL: https://issues.apache.org/jira/browse/FALCON-446
>             Project: Falcon
>          Issue Type: Bug
>          Components: replication
>    Affects Versions: 0.5
>            Reporter: Venkatesh Seetharam
>            Assignee: Venkatesh Seetharam
>              Labels: hive
>             Fix For: 0.6
>
>         Attachments: FALCON-446-v1.patch, FALCON-446.patch
>
>
> {code}
> 3782 [main] INFO  org.apache.hadoop.hive.ql.exec.Task  - Copying data from file:/grid/0/hdp/yarn/local/usercache/hrt_qa/appcache/application_1400833228766_0501/container_1400833228766_0501_01_000002/tmp/yarn/hive_2014-05-23_12-29-47_090_1701018059611451226-1/-local-10000/_metadata
to hdfs://hor3n25.gq1.ygridcore.net:8020/projects/ivory/staging/FALCON_FEED_REPLICATION_raaw-logs16-f80d8f5d-406e-49f8-8e2b-4caa58e53639_corp-6ce8cdf0-ce74-40fd-9601-143971a93eb9/default/HCatReplication_oneSourceOneTarget_hyphen/dt=2010-01-01-20/2010-01-01-20-00/corp-2a555e7f-1c65-4ac0-b3ef-1edd2c7fdd4b/data
> 3800 [main] ERROR org.apache.hadoop.hive.ql.exec.Task  - Failed with exception Permission
denied: user=hrt_qa, access=WRITE, inode="/projects/ivory/staging":falcon:hdfs:drwxr-xr-x
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:251)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:232)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:176)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5509)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5491)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:5465)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:3608)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:3578)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3552)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:760)
> 	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:558)
> 	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
> 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
> 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557)
> 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message