spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-22634) Update Bouncy castle dependency
Date Wed, 29 Nov 2017 16:09:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271012#comment-16271012
] 

Sean Owen commented on SPARK-22634:
-----------------------------------

Right, I see core depends on jets3t, so it's not just provided by Hadoop.
Looks reasonable, but maybe worth bumping jets3t to 0.9.4 as well; it fixes some bugs and
also ups the version of bouncy castle it wants, which may avoid problems with bumping bouncy
castle yet further.

> Update Bouncy castle dependency
> -------------------------------
>
>                 Key: SPARK-22634
>                 URL: https://issues.apache.org/jira/browse/SPARK-22634
>             Project: Spark
>          Issue Type: Task
>          Components: Spark Core, SQL, Structured Streaming
>    Affects Versions: 2.2.0
>            Reporter: Lior Regev
>            Priority: Minor
>
> Spark's usage of jets3t library as well as Spark's own Flume and Kafka streaming uses
bouncy castle version 1.51
> This is an outdated version as the latest one is 1.58
> This, in turn renders packages such as [spark-hadoopcryptoledger-ds|https://github.com/ZuInnoTe/spark-hadoopcryptoledger-ds]
unusable since these require 1.58 and spark's distributions come along with 1.51
> My own attempt was to run on EMR, and since I automatically get all of spark's dependecies
(bouncy castle 1.51 being one of them) into the classpath, using the library to parse blockchain
data failed due to missing functionality.
> I have also opened an [issue|https://bitbucket.org/jmurty/jets3t/issues/242/bouncycastle-dependency]
with jets3t to update their dependecy as well, but along with that Spark would have to update
it's own or at least be packaged with a newer version



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message