Mailing-List: contact issues-help@spark.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 29 Nov 2017 16:09:00 +0000 (UTC)
From: "Sean Owen (JIRA)" <jira@apache.org>
To: issues@spark.apache.org
Message-ID: <JIRA.13121342.1511881430000.346396.1511971740374@Atlassian.JIRA>
In-Reply-To: <JIRA.13121342.1511881430000@Atlassian.JIRA>
References: <JIRA.13121342.1511881430000@Atlassian.JIRA> <JIRA.13121342.1511881430114@jira-lw-us.apache.org>
Subject: [jira] [Commented] (SPARK-22634) Update Bouncy castle dependency
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 29 Nov 2017 16:09:06 -0000


    [ https://issues.apache.org/jira/browse/SPARK-22634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271012#comment-16271012 ] 

Sean Owen commented on SPARK-22634:
-----------------------------------

Right, I see core depends on jets3t, so it's not just provided by Hadoop.
Looks reasonable, but maybe worth bumping jets3t to 0.9.4 as well; it fixes some bugs and also ups the version of bouncy castle it wants, which may avoid problems with bumping bouncy castle yet further.

> Update Bouncy castle dependency
> -------------------------------
>
>                 Key: SPARK-22634
>                 URL: https://issues.apache.org/jira/browse/SPARK-22634
>             Project: Spark
>          Issue Type: Task
>          Components: Spark Core, SQL, Structured Streaming
>    Affects Versions: 2.2.0
>            Reporter: Lior Regev
>            Priority: Minor
>
> Spark's usage of jets3t library as well as Spark's own Flume and Kafka streaming uses bouncy castle version 1.51
> This is an outdated version as the latest one is 1.58
> This, in turn renders packages such as [spark-hadoopcryptoledger-ds|https://github.com/ZuInnoTe/spark-hadoopcryptoledger-ds] unusable since these require 1.58 and spark's distributions come along with 1.51
> My own attempt was to run on EMR, and since I automatically get all of spark's dependecies (bouncy castle 1.51 being one of them) into the classpath, using the library to parse blockchain data failed due to missing functionality.
> I have also opened an [issue|https://bitbucket.org/jmurty/jets3t/issues/242/bouncycastle-dependency] with jets3t to update their dependecy as well, but along with that Spark would have to update it's own or at least be packaged with a newer version


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org