flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chesnay Schepler (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-6965) Avro is missing snappy dependency
Date Tue, 11 Jul 2017 17:47:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082625#comment-16082625
] 

Chesnay Schepler commented on FLINK-6965:
-----------------------------------------

1.4: 021d27d54960bedd58b00e89f7898a34f3991336

> Avro is missing snappy dependency
> ---------------------------------
>
>                 Key: FLINK-6965
>                 URL: https://issues.apache.org/jira/browse/FLINK-6965
>             Project: Flink
>          Issue Type: Bug
>          Components: Type Serialization System
>    Affects Versions: 1.3.0
>            Reporter: Chesnay Schepler
>            Assignee: Chesnay Schepler
>            Priority: Blocker
>             Fix For: 1.3.2
>
>
> The shading rework made before 1.3 removed a snappy dependency that was accidentally
pulled in through hadoop. This is technically alright, until class-loaders rear their ugly
heads.
> Our kafka connector can read avro records, which may or may not require snappy. Usually
this _should_ be solvable by including the snappy dependency in the user-jar if necessary,
however since the kafka connector loads classes that it requires using the system class loader
this doesn't work.
> As such we have to add a separate snappy dependency to flink-core.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message