hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wang Haihua (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13120) propagate doAs when generating ORC splits
Date Tue, 11 Apr 2017 09:25:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964063#comment-15964063
] 

Wang Haihua commented on HIVE-13120:
------------------------------------

great, we have met this issue also. It happens when: 
1. ORCInputFormat when created by userA in `FetchOperator.java`, and `Context.threadpool`
was also initialized. Since the ORCInputformat is cached in `FetchOperator.java`, the UGI
in `Context.threadpool` thread will be userA always.



> propagate doAs when generating ORC splits
> -----------------------------------------
>
>                 Key: HIVE-13120
>                 URL: https://issues.apache.org/jira/browse/HIVE-13120
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Yi Zhang
>            Assignee: Sergey Shelukhin
>             Fix For: 2.0.1, 2.1.0
>
>         Attachments: HIVE-13120-branch-1.WIP.patch, HIVE-13120.patch
>
>
> ORC+HS2+doAs+FetchTask conversion = weird permission errors, e.g. 
> {noformat}
> 2016-02-22 17:24:39,005 WARN  [HiveServer2-Handler-Pool: Thread-587]: thrift.ThriftCLIService
(ThriftCLIService.java:FetchResults(681)) - Error fetching results:
> org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.RuntimeException:
serious problem
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:352)
> [snip]
> Caused by: java.io.IOException: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415)
>         at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
>         at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1720)
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:347)
>         ... 24 more
> Caused by: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1059)
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1086)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:363)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446)
>         ... 28 more
> Caused by: java.util.concurrent.ExecutionException: org.apache.hadoop.security.AccessControlException:
Permission denied: user=[snip], access=READ_EXECUTE, inode=[snip]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message