hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Takanobu Asanuma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11527) bypass HiveServer2 thrift interface for query results
Date Wed, 16 Mar 2016 08:57:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197055#comment-15197055
] 

Takanobu Asanuma commented on HIVE-11527:
-----------------------------------------

Hi [~sershe], [~vgumashta]

Thanks to the discussion with [~jingzhao], I implemented features for handling HA. I uploaded
a WIP patch on RB. Please review it.

I will continue the rest of the work.
・Until now, I assumed that intermediate results' format is the text format. But we need
to make jdbc clients decode other file formats. That is even more important since sequence
file is the default format for intermediate results, which was currently implemented in HIVE-1608.
・Considering multiple intermediate files.
・Adding some unit tests. HA tests depend on HIVE-13268 (Could you also review this?). 

Thanks.

> bypass HiveServer2 thrift interface for query results
> -----------------------------------------------------
>
>                 Key: HIVE-11527
>                 URL: https://issues.apache.org/jira/browse/HIVE-11527
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>            Reporter: Sergey Shelukhin
>            Assignee: Takanobu Asanuma
>         Attachments: HIVE-11527.WIP.patch
>
>
> Right now, HS2 reads query results and returns them to the caller via its thrift API.
> There should be an option for HS2 to return some pointer to results (an HDFS link?) and
for the user to read the results directly off HDFS inside the cluster, or via something like
WebHDFS outside the cluster
> Review board link: https://reviews.apache.org/r/40867



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message