Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1A5362004A0 for ; Wed, 16 Aug 2017 17:17:02 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 18129166D34; Wed, 16 Aug 2017 15:17:02 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 1132D166D1F for ; Wed, 16 Aug 2017 17:17:00 +0200 (CEST) Received: (qmail 67667 invoked by uid 500); 16 Aug 2017 15:16:59 -0000 Mailing-List: contact commits-help@bahir.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@bahir.apache.org Delivered-To: mailing list commits@bahir.apache.org Received: (qmail 67658 invoked by uid 99); 16 Aug 2017 15:16:59 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Aug 2017 15:16:59 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id AA133DFC61; Wed, 16 Aug 2017 15:16:59 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: lresende@apache.org To: commits@bahir.apache.org Message-Id: <1c166476d5124c1c9d381e23e48a4414@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: bahir git commit: [MINOR] Use jekyll template to describe Spark and Scala version Date: Wed, 16 Aug 2017 15:16:59 +0000 (UTC) archived-at: Wed, 16 Aug 2017 15:17:02 -0000 Repository: bahir Updated Branches: refs/heads/master e491610d8 -> 49cde19a9 [MINOR] Use jekyll template to describe Spark and Scala version Project: http://git-wip-us.apache.org/repos/asf/bahir/repo Commit: http://git-wip-us.apache.org/repos/asf/bahir/commit/49cde19a Tree: http://git-wip-us.apache.org/repos/asf/bahir/tree/49cde19a Diff: http://git-wip-us.apache.org/repos/asf/bahir/diff/49cde19a Branch: refs/heads/master Commit: 49cde19a95d66bc38230eec71eec6ea51ffa2589 Parents: e491610 Author: Luciano Resende Authored: Tue Aug 15 13:27:19 2017 -0600 Committer: Luciano Resende Committed: Wed Aug 16 09:16:51 2017 -0600 ---------------------------------------------------------------------- sql-cloudant/README.md | 16 ++++++++-------- sql-streaming-akka/README.md | 8 ++++---- sql-streaming-mqtt/README.md | 8 ++++---- streaming-akka/README.md | 8 ++++---- streaming-mqtt/README.md | 8 ++++---- streaming-pubsub/README.md | 8 ++++---- streaming-twitter/README.md | 8 ++++---- streaming-zeromq/README.md | 8 ++++---- 8 files changed, 36 insertions(+), 36 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/sql-cloudant/README.md ---------------------------------------------------------------------- diff --git a/sql-cloudant/README.md b/sql-cloudant/README.md index 4fd1c9c..18118eb 100644 --- a/sql-cloudant/README.md +++ b/sql-cloudant/README.md @@ -12,30 +12,30 @@ clusters, desktop PCs, and mobile devices. Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-sql-cloudant" % "2.2.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-sql-cloudant" % "{{site.SPARK_VERSION}}" Using Maven: org.apache.bahir - spark-sql-cloudant_2.11 - 2.2.0-SNAPSHOT + spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}} + {{site.SPARK_VERSION}} This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. - $ bin/spark-shell --packages org.apache.bahir:spark-sql-cloudant_2.11:2.2.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. Submit a job in Python: - spark-submit --master local[4] --packages org.apache.bahir:spark-sql-cloudant_SCALA_VERSION:PACKAGE_VERSION + spark-submit --master local[4] --packages org.apache.bahir:spark-sql-cloudant__{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Submit a job in Scala: - spark-submit --class "" --master local[4] --packages org.apache.bahir:spark-sql-cloudant_SCALA_VERSION:PACKAGE_VERSION + spark-submit --class "" --master local[4] --packages org.apache.bahir:spark-sql-cloudant__{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} This library is compiled for Scala 2.11 only, and intends to support Spark 2.0 onwards. @@ -163,7 +163,7 @@ See [CloudantApp.py](examples/python/CloudantApp.py) for examples. Submit job example: ``` -spark-submit --packages org.apache.bahir:spark-sql-cloudant_2.11:2.2.0-SNAPSHOT --conf spark.cloudant.host=ACCOUNT.cloudant.com --conf spark.cloudant.username=USERNAME --conf spark.cloudant.password=PASSWORD sql-cloudant/examples/python/CloudantApp.py +spark-submit --packages org.apache.bahir:spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} --conf spark.cloudant.host=ACCOUNT.cloudant.com --conf spark.cloudant.username=USERNAME --conf spark.cloudant.password=PASSWORD sql-cloudant/examples/python/CloudantApp.py ``` #### Using DataFrame In Python @@ -233,7 +233,7 @@ See [CloudantApp.scala](examples/scala/src/main/scala/mytest/spark/CloudantApp.s Submit job example: ``` -spark-submit --class org.apache.spark.examples.sql.cloudant.CloudantApp --packages org.apache.bahir:spark-sql-cloudant_2.11:2.2.0-SNAPSHOT --conf spark.cloudant.host=ACCOUNT.cloudant.com --conf spark.cloudant.username=USERNAME --conf spark.cloudant.password=PASSWORD /path/to/spark-sql-cloudant_2.11-2.2.0-SNAPSHOT-tests.jar +spark-submit --class org.apache.spark.examples.sql.cloudant.CloudantApp --packages org.apache.bahir:spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} --conf spark.cloudant.host=ACCOUNT.cloudant.com --conf spark.cloudant.username=USERNAME --conf spark.cloudant.password=PASSWORD /path/to/spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}}-{{site.SPARK_VERSION}}-tests.jar ``` ### Using DataFrame In Scala http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/sql-streaming-akka/README.md ---------------------------------------------------------------------- diff --git a/sql-streaming-akka/README.md b/sql-streaming-akka/README.md index b64a8e2..3d9d17b 100644 --- a/sql-streaming-akka/README.md +++ b/sql-streaming-akka/README.md @@ -4,20 +4,20 @@ A library for reading data from Akka Actors using Spark SQL Streaming ( or Struc Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-sql-streaming-akka" % "2.2.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-sql-streaming-akka" % "{{site.SPARK_VERSION}}" Using Maven: org.apache.bahir - spark-sql-streaming-akka_2.11 - 2.2.0-SNAPSHOT + spark-sql-streaming-akka_{{site.SCALA_BINARY_VERSION}} + {{site.SPARK_VERSION}} This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-sql-streaming-akka_2.11:2.2.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-sql-streaming-akka_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/sql-streaming-mqtt/README.md ---------------------------------------------------------------------- diff --git a/sql-streaming-mqtt/README.md b/sql-streaming-mqtt/README.md index c9ea8cf..2cfbe0f 100644 --- a/sql-streaming-mqtt/README.md +++ b/sql-streaming-mqtt/README.md @@ -4,20 +4,20 @@ A library for reading data from MQTT Servers using Spark SQL Streaming ( or Stru Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-sql-streaming-mqtt" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-sql-streaming-mqtt" % "{{site.SPARK_VERSION}}" Using Maven: org.apache.bahir - spark-sql-streaming-mqtt_2.11 - 2.1.0-SNAPSHOT + spark-sql-streaming-mqtt_{{site.SCALA_BINARY_VERSION}} + {{site.SPARK_VERSION}} This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-sql-streaming-mqtt_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-sql-streaming-mqtt_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-akka/README.md ---------------------------------------------------------------------- diff --git a/streaming-akka/README.md b/streaming-akka/README.md index 9c642aa..f57583e 100644 --- a/streaming-akka/README.md +++ b/streaming-akka/README.md @@ -5,20 +5,20 @@ A library for reading data from Akka Actors using Spark Streaming. Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-akka" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-akka" % "{{site.SPARK_VERSION}}" Using Maven: org.apache.bahir - spark-streaming-akka_2.11 - 2.1.0-SNAPSHOT + spark-streaming-akka_{{site.SCALA_BINARY_VERSION}} + {{site.SPARK_VERSION}} This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-akka_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-akka_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-mqtt/README.md ---------------------------------------------------------------------- diff --git a/streaming-mqtt/README.md b/streaming-mqtt/README.md index 5117594..644e5fb 100644 --- a/streaming-mqtt/README.md +++ b/streaming-mqtt/README.md @@ -5,20 +5,20 @@ Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-mqtt" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-mqtt" % "{{site.SPARK_VERSION}}" Using Maven: org.apache.bahir - spark-streaming-mqtt_2.11 - 2.1.0-SNAPSHOT + spark-streaming-mqtt_{{site.SCALA_BINARY_VERSION}} + {{site.SPARK_VERSION}} This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-mqtt_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-mqtt_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-pubsub/README.md ---------------------------------------------------------------------- diff --git a/streaming-pubsub/README.md b/streaming-pubsub/README.md index db207ae..a8f374f 100644 --- a/streaming-pubsub/README.md +++ b/streaming-pubsub/README.md @@ -4,20 +4,20 @@ A library for reading data from [Google Cloud Pub/Sub](https://cloud.google.com/ Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-pubsub" % "2.2.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-pubsub" % "{{site.SPARK_VERSION}}" Using Maven: org.apache.bahir - spark-streaming-pubsub_2.11 - 2.2.0-SNAPSHOT + spark-streaming-pubsub_{{site.SCALA_BINARY_VERSION}} + {{site.SPARK_VERSION}} This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-pubsub_2.11:2.2.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-pubsub_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-twitter/README.md ---------------------------------------------------------------------- diff --git a/streaming-twitter/README.md b/streaming-twitter/README.md index 18f228f..0b3d37a 100644 --- a/streaming-twitter/README.md +++ b/streaming-twitter/README.md @@ -5,20 +5,20 @@ A library for reading social data from [twitter](http://twitter.com/) using Spar Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-twitter" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-twitter" % "{{site.SPARK_VERSION}}" Using Maven: org.apache.bahir - spark-streaming-twitter_2.11 - 2.1.0-SNAPSHOT + spark-streaming-twitter_{{site.SCALA_BINARY_VERSION}} + {{site.SPARK_VERSION}} This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-twitter_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-twitter_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-zeromq/README.md ---------------------------------------------------------------------- diff --git a/streaming-zeromq/README.md b/streaming-zeromq/README.md index 37835e3..952bb4f 100644 --- a/streaming-zeromq/README.md +++ b/streaming-zeromq/README.md @@ -5,20 +5,20 @@ A library for reading data from [ZeroMQ](http://zeromq.org/) using Spark Streami Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-zeromq" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-zeromq" % "{{site.SPARK_VERSION}}" Using Maven: org.apache.bahir - spark-streaming-zeromq_2.11 - 2.1.0-SNAPSHOT + spark-streaming-zeromq_{{site.SCALA_BINARY_VERSION}} + {{site.SPARK_VERSION}} This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-zeromq_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-zeromq_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`.