drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Rogers (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5074) Excessive logging for permission denied error in CTAS
Date Sun, 27 Nov 2016 20:11:58 GMT
Paul Rogers created DRILL-5074:
----------------------------------

             Summary: Excessive logging for permission denied error in CTAS
                 Key: DRILL-5074
                 URL: https://issues.apache.org/jira/browse/DRILL-5074
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.8.0
            Reporter: Paul Rogers
            Priority: Minor


Consider the test TestImpersonationMetadata.testCreateTableInWSWithNoPermissionsForQueryUser.
This test attempts to do a CTAS in a workspace without proper permissions. A perfectly fine
test for perfectly normal scenario. However, the test displays the following very long log
message for what is, in essence, a very simple condition.

Expected that Drill would expect permission problems, would log a single message ("User fred
attempted to access Table foo without proper permissions"), and omit the gory details of the
stack trace. Since this is a normal operating problem, and not a code fault, the stack trace
simply clutters the log (and test output.)

Note: the test is being modified to suppress the logging. If you attempt to reproduce the
problem using the test after that modification, comment out the call to {{disableWriterLogging()}}.

{code}
22:01:29.890 [27c58945-c8c1-5c3d-6ebc-9926c33ced48:frag:0:0] ERROR o.a.d.e.p.impl.WriterRecordBatch
- Failure during query
org.apache.hadoop.security.AccessControlException: Permission denied: user=drillTestUser2,
access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213)
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190)
...
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_102]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_102]
    at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
Caused by: org.apache.hadoop.ipc.RemoteException: Permission denied: user=drillTestUser2,
access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
...
   at com.sun.proxy.$Proxy67.create(Unknown Source) ~[na:na]
    at org.apache.hadoop.hdfs.DFSOutputStream.newStreamForCreate(DFSOutputStream.java:1623)
~[hadoop-hdfs-2.7.1.jar:na]
    ... 35 common frames omitted
22:01:29.987 [27c58945-c8c1-5c3d-6ebc-9926c33ced48:frag:0:0] ERROR o.a.d.e.w.fragment.FragmentExecutor
- SYSTEM ERROR: RemoteException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
...
   at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2045)


Fragment 0:0

[Error Id: fff615a2-006d-4a33-a87c-f0d1c25d246f on 172.30.1.66:31013]
org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: RemoteException: Permission
denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
...
   at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2045)


Fragment 0:0

[Error Id: fff615a2-006d-4a33-a87c-f0d1c25d246f on 172.30.1.66:31013]
    at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:543)
~[drill-common-1.9.0-SNAPSHOT.jar:1.9.0-SNAPSHOT]
...
    at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102]
Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=drillTestUser2,
access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292)
...
   at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:226)
[classes/:na]
    ... 4 common frames omitted
Caused by: org.apache.hadoop.ipc.RemoteException: Permission denied: user=drillTestUser2,
access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x
    at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320)
...
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message