hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5263) Query Plan cloning time could be improved by using Kryo
Date Wed, 11 Sep 2013 16:39:52 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13764463#comment-13764463
] 

Ashutosh Chauhan commented on HIVE-5263:
----------------------------------------

I understand that current patch is WIP, but we need to make sure qbJoinTree and opParseCtx
(in MapWork) are not serialized while we serialize the plan. Those are pretty bulky objects
which are not required at execution time. I think its possible to do this with Kryo.
                
> Query Plan  cloning time could be improved by using Kryo
> --------------------------------------------------------
>
>                 Key: HIVE-5263
>                 URL: https://issues.apache.org/jira/browse/HIVE-5263
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Brock Noland
>            Assignee: Brock Noland
>         Attachments: HIVE-5263.patch, HIVE-5263.patch
>
>
> In HIVE-1511 we implemented Kryo for serialization but did not use for query plan cloning.
As was discussed there it's a possible speed improvement. In addition the current XML serialization
method does not work with Java 7 so using Kryo is a workaround for this issue.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message