spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Commented] (SPARK-22634) Update Bouncy castle dependency
Date Wed, 29 Nov 2017 16:09:00 GMT


Sean Owen commented on SPARK-22634:

Right, I see core depends on jets3t, so it's not just provided by Hadoop.
Looks reasonable, but maybe worth bumping jets3t to 0.9.4 as well; it fixes some bugs and
also ups the version of bouncy castle it wants, which may avoid problems with bumping bouncy
castle yet further.

> Update Bouncy castle dependency
> -------------------------------
>                 Key: SPARK-22634
>                 URL:
>             Project: Spark
>          Issue Type: Task
>          Components: Spark Core, SQL, Structured Streaming
>    Affects Versions: 2.2.0
>            Reporter: Lior Regev
>            Priority: Minor
> Spark's usage of jets3t library as well as Spark's own Flume and Kafka streaming uses
bouncy castle version 1.51
> This is an outdated version as the latest one is 1.58
> This, in turn renders packages such as [spark-hadoopcryptoledger-ds|]
unusable since these require 1.58 and spark's distributions come along with 1.51
> My own attempt was to run on EMR, and since I automatically get all of spark's dependecies
(bouncy castle 1.51 being one of them) into the classpath, using the library to parse blockchain
data failed due to missing functionality.
> I have also opened an [issue|]
with jets3t to update their dependecy as well, but along with that Spark would have to update
it's own or at least be packaged with a newer version

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message