falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shwetha G S (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-446) Hive Replications fail because of permissions issue
Date Mon, 26 May 2014 06:55:01 GMT

    [ https://issues.apache.org/jira/browse/FALCON-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008619#comment-14008619
] 

Shwetha G S commented on FALCON-446:
------------------------------------

This is hcat replication which is implemented as export, copy and import. export and import
location is not user controlled and is chosen by falcon. So, falcon should make sure the permissions
are correctly set

> Hive Replications fail because of permissions issue
> ---------------------------------------------------
>
>                 Key: FALCON-446
>                 URL: https://issues.apache.org/jira/browse/FALCON-446
>             Project: Falcon
>          Issue Type: Bug
>          Components: replication
>    Affects Versions: 0.5
>            Reporter: Venkatesh Seetharam
>
> {code}
> 3782 [main] INFO  org.apache.hadoop.hive.ql.exec.Task  - Copying data from file:/grid/0/hdp/yarn/local/usercache/hrt_qa/appcache/application_1400833228766_0501/container_1400833228766_0501_01_000002/tmp/yarn/hive_2014-05-23_12-29-47_090_1701018059611451226-1/-local-10000/_metadata
to hdfs://hor3n25.gq1.ygridcore.net:8020/projects/ivory/staging/FALCON_FEED_REPLICATION_raaw-logs16-f80d8f5d-406e-49f8-8e2b-4caa58e53639_corp-6ce8cdf0-ce74-40fd-9601-143971a93eb9/default/HCatReplication_oneSourceOneTarget_hyphen/dt=2010-01-01-20/2010-01-01-20-00/corp-2a555e7f-1c65-4ac0-b3ef-1edd2c7fdd4b/data
> 3800 [main] ERROR org.apache.hadoop.hive.ql.exec.Task  - Failed with exception Permission
denied: user=hrt_qa, access=WRITE, inode="/projects/ivory/staging":falcon:hdfs:drwxr-xr-x
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkFsPermission(FSPermissionChecker.java:265)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:251)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:232)
> 	at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:176)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5509)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:5491)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkAncestorAccess(FSNamesystem.java:5465)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:3608)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:3578)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3552)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:760)
> 	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:558)
> 	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
> 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
> 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557)
> 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message