hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-13120) propagate doAs when generating ORC splits
Date Mon, 07 Nov 2016 20:46:59 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645398#comment-15645398
] 

Sergey Shelukhin edited comment on HIVE-13120 at 11/7/16 8:46 PM:
------------------------------------------------------------------

Updated the description with the callstack. The repro is not reliable since this is a concurrency
issue... Running beeline repeatedly as two users (user1, then user2, then user1, etc.), with
simple selects against two corresponding tables, such as that each user only has access to
his own table, on fresh HS2, might do the trick. Running the same from multiple terminals
in parallel might help too.

IIRC we have a backport to branch-1 lying around somewhere, I can try to find it if this is
the issue you are hitting.


was (Author: sershe):
Updated the description with the callstack. The repro is not reliable since this is a concurrency
issue... Running beeline repeatedly as two users (user1, then user2, then user1, etc.), with
simple selects against two corresponding tables, such as that each user only has access to
his own table, on fresh HS2, might do the trick. Running the same from multiple machines might
help too.

IIRC we have a backport to branch-1 lying around somewhere, I can try to find it if this is
the issue you are hitting.

> propagate doAs when generating ORC splits
> -----------------------------------------
>
>                 Key: HIVE-13120
>                 URL: https://issues.apache.org/jira/browse/HIVE-13120
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Yi Zhang
>            Assignee: Sergey Shelukhin
>             Fix For: 2.1.0, 2.0.1
>
>         Attachments: HIVE-13120.patch
>
>
> ORC+HS2+doAs+FetchTask conversion = weird permission errors, e.g. 
> {noformat}
> 2016-02-22 17:24:39,005 WARN  [HiveServer2-Handler-Pool: Thread-587]: thrift.ThriftCLIService
(ThriftCLIService.java:FetchResults(681)) - Error fetching results:
> org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.RuntimeException:
serious problem
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:352)
> [snip]
> Caused by: java.io.IOException: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415)
>         at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
>         at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1720)
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:347)
>         ... 24 more
> Caused by: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1059)
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1086)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:363)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446)
>         ... 28 more
> Caused by: java.util.concurrent.ExecutionException: org.apache.hadoop.security.AccessControlException:
Permission denied: user=[snip], access=READ_EXECUTE, inode=[snip]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message