spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From t...@apache.org
Subject spark git commit: [SPARK-11127][STREAMING] upgrade AWS SDK and Kinesis Client Library (KCL)
Date Mon, 26 Oct 2015 04:57:39 GMT
Repository: spark
Updated Branches:
  refs/heads/master 85e654c5e -> 87f82a5fb


[SPARK-11127][STREAMING] upgrade AWS SDK and Kinesis Client Library (KCL)

AWS SDK 1.9.40 is the latest 1.9.x release. KCL 1.5.1 is the latest release that using AWS
SDK 1.9.x. The main goal is to have Kinesis consumer be able to read messages generated from
Kinesis Producer Library (KPL). The API should be compatible with old versions.

tdas brkyvz

Author: Xiangrui Meng <meng@databricks.com>

Closes #9153 from mengxr/SPARK-11127.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/87f82a5f
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/87f82a5f
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/87f82a5f

Branch: refs/heads/master
Commit: 87f82a5fb9c4350a97c761411069245f07aad46f
Parents: 85e654c
Author: Xiangrui Meng <meng@databricks.com>
Authored: Sun Oct 25 21:57:34 2015 -0700
Committer: Tathagata Das <tathagata.das1565@gmail.com>
Committed: Sun Oct 25 21:57:34 2015 -0700

----------------------------------------------------------------------
 pom.xml | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/87f82a5f/pom.xml
----------------------------------------------------------------------
diff --git a/pom.xml b/pom.xml
index 445e65c..3dfc434 100644
--- a/pom.xml
+++ b/pom.xml
@@ -152,8 +152,8 @@
     <avro.version>1.7.7</avro.version>
     <avro.mapred.classifier>hadoop2</avro.mapred.classifier>
     <jets3t.version>0.7.1</jets3t.version>
-    <aws.java.sdk.version>1.9.16</aws.java.sdk.version>
-    <aws.kinesis.client.version>1.3.0</aws.kinesis.client.version>
+    <aws.java.sdk.version>1.9.40</aws.java.sdk.version>
+    <aws.kinesis.client.version>1.4.0</aws.kinesis.client.version>
     <!--  org.apache.httpcomponents/httpclient-->
     <commons.httpclient.version>4.3.2</commons.httpclient.version>
     <!--  commons-httpclient/commons-httpclient-->


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message