hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Takanobu Asanuma (JIRA)" <>
Subject [jira] [Updated] (HIVE-11527) bypass HiveServer2 thrift interface for query results
Date Fri, 27 Nov 2015 06:30:12 GMT


Takanobu Asanuma updated HIVE-11527:
    Attachment: HIVE-11527.WIP.patch

Hi [~sershe], [~vgumashta]

I uploaded a WIP patch.

* I added a new configuration whose name is hive.server2.webhdfs.bypass.enabled. The default
is false. When this value is true, clients use the bypass.
* I still have not considered security such as Kerberos and SSL at present.
* I have not implement Statement#setFetchSize for bypass yet.
* I have tested few simple queries and they worked well. But I think there are some problems
for some queries. I'm going to test more queries and fix bugs. I'm also going to add unit

Please could you review it? And let me know if you have any comments for this patch. Thank

> bypass HiveServer2 thrift interface for query results
> -----------------------------------------------------
>                 Key: HIVE-11527
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>            Reporter: Sergey Shelukhin
>            Assignee: Takanobu Asanuma
>         Attachments: HIVE-11527.WIP.patch
> Right now, HS2 reads query results and returns them to the caller via its thrift API.
> There should be an option for HS2 to return some pointer to results (an HDFS link?) and
for the user to read the results directly off HDFS inside the cluster, or via something like
WebHDFS outside the cluster

This message was sent by Atlassian JIRA

View raw message