beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From git-site-r...@apache.org
Subject [beam] branch asf-site updated: Publishing website 2021/08/31 18:01:38 at commit dd7945f
Date Tue, 31 Aug 2021 18:02:14 GMT
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
     new 723892c  Publishing website 2021/08/31 18:01:38 at commit dd7945f
723892c is described below

commit 723892cfd914490aeede649e9281215a2c46d168
Author: jenkins <builds@apache.org>
AuthorDate: Tue Aug 31 18:01:39 2021 +0000

    Publishing website 2021/08/31 18:01:38 at commit dd7945f
---
 website/generated-content/documentation/runners/spark/index.html | 4 ++--
 website/generated-content/sitemap.xml                            | 2 +-
 2 files changed, 3 insertions(+), 3 deletions(-)

diff --git a/website/generated-content/documentation/runners/spark/index.html b/website/generated-content/documentation/runners/spark/index.html
index a26bb01..252f402 100644
--- a/website/generated-content/documentation/runners/spark/index.html
+++ b/website/generated-content/documentation/runners/spark/index.html
@@ -18,7 +18,7 @@
 function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");}
 function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var
icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
 function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix
container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span
class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span class=section-nav-list-main-title>Runners</span></li><li><a
href=/documentation/runners/capability-matrix/>Capability Matrix</a></li><li><a
href=/documentation/runners/direct/>Direct Ru [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix
container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span
class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span class=section-nav-list-main-title>Runners</span></li><li><a
href=/documentation/runners/capability-matrix/>Capability Matrix</a></li><li><a
href=/documentation/runners/direct/>Direct Ru [...]
 The Spark Runner can execute Spark pipelines just like a native Spark application; deploying
a self-contained application for local mode, running on Spark&rsquo;s Standalone RM, or
using YARN or Mesos.</p><p>The Spark Runner executes Beam pipelines on top of
Apache Spark, providing:</p><ul><li>Batch and streaming (and combined) pipelines.</li><li>The
same fault-tolerance <a href=https://spark.apache.org/docs/latest/streaming-programming-guide.html#fault-tolerance-semantics>guarantees</a>
[...]
 the portable functionality of the Spark Runner. Please use the switcher below to
 select the appropriate Runner:</p><h2 id=which-runner-to-use-portable-or-non-portable-runner>Which
runner to use: portable or non portable runner?</h2><p>Beam and its Runners originally
only supported JVM-based languages
@@ -99,7 +99,7 @@ Passing any of the above mentioned options could be done as one of the <code>app
 For more on how to generally use <code>spark-submit</code> checkout Spark <a
href=https://spark.apache.org/docs/latest/submitting-applications.html#launching-applications-with-spark-submit>documentation</a>.</p><h3
id=monitoring-your-job>Monitoring your job</h3><p>You can monitor a running
Spark job using the Spark <a href=https://spark.apache.org/docs/latest/monitoring.html#web-interfaces>Web
Interfaces</a>. By default, this is available at port <code>4040</code>
on the driver node. If  [...]
 Spark also has a history server to <a href=https://spark.apache.org/docs/latest/monitoring.html#viewing-after-the-fact>view
after the fact</a>.<p class=language-java>Metrics are also available via <a
href=https://spark.apache.org/docs/latest/monitoring.html#rest-api>REST API</a>.
 Spark provides a <a href=https://spark.apache.org/docs/latest/monitoring.html#metrics>metrics
system</a> that allows reporting Spark metrics to a variety of Sinks. The Spark runner
reports user-defined Beam Aggregators using this same metrics system and currently supports
<code>GraphiteSink</code> and <code>CSVSink</code>, and providing
support for additional Sinks supported by Spark is easy and straight-forward.</p><p
class=language-py>Spark metrics are not yet supported on the portable [...]
-Instead, you should use <code>SparkContextOptions</code> which can only be used
programmatically and is not a common <code>PipelineOptions</code> implementation.<br><br><b>For
Structured Streaming based runner:</b><br>Provided SparkSession and StreamingListeners
are not supported on the Spark Structured Streaming runner</p><p class=language-py>Provided
SparkContext and StreamingListeners are not supported on the Spark portable runner.</p><div
class=feedback><p class=update>Last updated o [...]
+Instead, you should use <code>SparkContextOptions</code> which can only be used
programmatically and is not a common <code>PipelineOptions</code> implementation.<br><br><b>For
Structured Streaming based runner:</b><br>Provided SparkSession and StreamingListeners
are not supported on the Spark Structured Streaming runner</p><p class=language-py>Provided
SparkContext and StreamingListeners are not supported on the Spark portable runner.</p><h3
id=kubernetes>Kubernetes</h3><p>An <a href=htt [...]
 <a href=http://www.apache.org>The Apache Software Foundation</a>
 | <a href=/privacy_policy>Privacy Policy</a>
 | <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam,
the Beam logo, and the Apache feather logo are either registered trademarks or trademarks
of The Apache Software Foundation. All other products or name brands are trademarks of their
respective holders, including The Apache Software Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index 0689eb2..a421c83 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.32.0/</loc><lastmod>2021-08-26T11:29:05-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2021-08-26T11:29:05-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2021-08-26T11:29:05-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2021-08-26T11:29:05-07:00</lastmod></url><url><loc>/blog/b
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.32.0/</loc><lastmod>2021-08-26T11:29:05-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2021-08-26T11:29:05-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2021-08-26T11:29:05-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2021-08-26T11:29:05-07:00</lastmod></url><url><loc>/blog/b
[...]
\ No newline at end of file

Mime
View raw message