hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang_intel (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15259) The deserialization time of HOS20 is longer than what in HOS16
Date Wed, 30 Nov 2016 03:47:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707422#comment-15707422
] 

liyunzhang_intel commented on HIVE-15259:
-----------------------------------------

[~lirui]: Something update for this jira:
The serializer and  deserializer of HOS is Kryo. Kryo is related with cache. So if HOS20 run
before HO16. The time of deserialization of HOS20 is longer than HOS16. There is no obvious
difference in serialization and deserialization in HOS16 and HOS20. So I close this jira.

> The deserialization time of HOS20 is longer than what in  HOS16
> ---------------------------------------------------------------
>
>                 Key: HIVE-15259
>                 URL: https://issues.apache.org/jira/browse/HIVE-15259
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: liyunzhang_intel
>         Attachments: Deserialization_HOS16.PNG, Deserialization_HOS20.PNG
>
>
> deploy Hive on Spark on spark 1.6 version and spark 2.0 version.
> run query and in latest code(with spark2.0) the deserialization time of a task is 4 sec
while the deserialization time of spark1.6 is 1 sec. The detail is in attached picture.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message