hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12175) Upgrade Kryo version to 3.0.x
Date Wed, 14 Oct 2015 13:31:05 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14956939#comment-14956939
] 

Xuefu Zhang commented on HIVE-12175:
------------------------------------

Is 3.0.x compatible with 2.22?. It might break Hive on Spark due to any incompatibility issue.
Thus, I think we need to be careful about this upgrade.

> Upgrade Kryo version to 3.0.x
> -----------------------------
>
>                 Key: HIVE-12175
>                 URL: https://issues.apache.org/jira/browse/HIVE-12175
>             Project: Hive
>          Issue Type: Improvement
>          Components: Serializers/Deserializers
>    Affects Versions: 2.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>
> Current version of kryo (2.22) has some issue with serializing ArrayLists generated using
Arrays.asList(). We need to either replace all occurrences of  Arrays.asList() or change the
current StdInstantiatorStrategy. This issue is fixed in later versions and kryo community
recommends using DefaultInstantiatorStrategy with fallback to StdInstantiatorStrategy. More
discussion about this issue is here https://github.com/EsotericSoftware/kryo/issues/216. Alternatively,
custom serilization/deserilization class can be provided for Arrays.asList.
> Also, kryo 3.0 introduced unsafe based serialization which claims to have much better
performance for certain types of serialization. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message