hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Drome (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13120) propagate doAs when generating ORC splits
Date Mon, 07 Nov 2016 20:50:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645413#comment-15645413
] 

Chris Drome commented on HIVE-13120:
------------------------------------

[~sershe], can you confirm that user in the exception message:

{noformat}
Caused by: java.util.concurrent.ExecutionException: org.apache.hadoop.security.AccessControlException:
Permission denied: user=[snip], access=READ_EXECUTE, inode=[snip]
{noformat}

is different from the user that submitted the query?

Also, I tried reproducing in the manner you suggested, but no luck. I'm wondering if this
isn't something specific to the Python API. The Java API looks very well encapsulated such
that a results for results can't come from a different thread/connection.

> propagate doAs when generating ORC splits
> -----------------------------------------
>
>                 Key: HIVE-13120
>                 URL: https://issues.apache.org/jira/browse/HIVE-13120
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Yi Zhang
>            Assignee: Sergey Shelukhin
>             Fix For: 2.1.0, 2.0.1
>
>         Attachments: HIVE-13120.patch
>
>
> ORC+HS2+doAs+FetchTask conversion = weird permission errors, e.g. 
> {noformat}
> 2016-02-22 17:24:39,005 WARN  [HiveServer2-Handler-Pool: Thread-587]: thrift.ThriftCLIService
(ThriftCLIService.java:FetchResults(681)) - Error fetching results:
> org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.RuntimeException:
serious problem
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:352)
> [snip]
> Caused by: java.io.IOException: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415)
>         at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
>         at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1720)
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:347)
>         ... 24 more
> Caused by: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1059)
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1086)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:363)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446)
>         ... 28 more
> Caused by: java.util.concurrent.ExecutionException: org.apache.hadoop.security.AccessControlException:
Permission denied: user=[snip], access=READ_EXECUTE, inode=[snip]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message