hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13120) propagate doAs when generating ORC splits
Date Tue, 08 Nov 2016 22:34:58 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sergey Shelukhin updated HIVE-13120:
------------------------------------
    Attachment: HIVE-13120-branch-1.WIP.patch

The patch that at some point used to apply to branch-1, potentially on top of some other patches.

Right now it has a lot of conflicts, however most of them are in the test code.
Feel free to rebase in separate JIRA ;)
Original backport was done by [~baluchicken]

> propagate doAs when generating ORC splits
> -----------------------------------------
>
>                 Key: HIVE-13120
>                 URL: https://issues.apache.org/jira/browse/HIVE-13120
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Yi Zhang
>            Assignee: Sergey Shelukhin
>             Fix For: 2.1.0, 2.0.1
>
>         Attachments: HIVE-13120-branch-1.WIP.patch, HIVE-13120.patch
>
>
> ORC+HS2+doAs+FetchTask conversion = weird permission errors, e.g. 
> {noformat}
> 2016-02-22 17:24:39,005 WARN  [HiveServer2-Handler-Pool: Thread-587]: thrift.ThriftCLIService
(ThriftCLIService.java:FetchResults(681)) - Error fetching results:
> org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.RuntimeException:
serious problem
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:352)
> [snip]
> Caused by: java.io.IOException: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415)
>         at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
>         at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1720)
>         at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:347)
>         ... 24 more
> Caused by: java.lang.RuntimeException: serious problem
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1059)
>         at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1086)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:363)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295)
>         at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446)
>         ... 28 more
> Caused by: java.util.concurrent.ExecutionException: org.apache.hadoop.security.AccessControlException:
Permission denied: user=[snip], access=READ_EXECUTE, inode=[snip]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message