spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From t...@apache.org
Subject spark git commit: [SPARK-5028][Streaming]Add total received and processed records metrics to Streaming UI
Date Wed, 31 Dec 2014 22:45:40 GMT
Repository: spark
Updated Branches:
  refs/heads/master 3610d3c61 -> fdc2aa491


[SPARK-5028][Streaming]Add total received and processed records metrics to Streaming UI

This is a follow-up work of [SPARK-4537](https://issues.apache.org/jira/browse/SPARK-4537).
Adding total received records and processed records metrics back to UI.

![screenshot](https://dl.dropboxusercontent.com/u/19230832/screenshot.png)

Author: jerryshao <saisai.shao@intel.com>

Closes #3852 from jerryshao/SPARK-5028 and squashes the following commits:

c8c4877 [jerryshao] Add total received and processed metrics to Streaming UI


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fdc2aa49
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/fdc2aa49
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/fdc2aa49

Branch: refs/heads/master
Commit: fdc2aa4918fd4c510f04812b782cc0bfef9a2107
Parents: 3610d3c
Author: jerryshao <saisai.shao@intel.com>
Authored: Wed Dec 31 14:45:31 2014 -0800
Committer: Tathagata Das <tathagata.das1565@gmail.com>
Committed: Wed Dec 31 14:45:31 2014 -0800

----------------------------------------------------------------------
 .../scala/org/apache/spark/streaming/ui/StreamingPage.scala    | 6 ++++++
 1 file changed, 6 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/fdc2aa49/streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala
----------------------------------------------------------------------
diff --git a/streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala b/streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala
index 1353e48..98e9a2e 100644
--- a/streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala
+++ b/streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala
@@ -67,6 +67,12 @@ private[ui] class StreamingPage(parent: StreamingTab)
       <li>
         <strong>Waiting batches: </strong>{listener.numUnprocessedBatches}
       </li>
+      <li>
+        <strong>Received records: </strong>{listener.numTotalReceivedRecords}
+      </li>
+      <li>
+        <strong>Processed records: </strong>{listener.numTotalProcessedRecords}
+      </li>
     </ul>
   }
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org


Mime
View raw message