spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From r...@apache.org
Subject git commit: Merge pull request #112 from kayousterhout/ui_task_attempt_id
Date Mon, 04 Nov 2013 07:41:28 GMT
Updated Branches:
  refs/heads/branch-0.8 57ea85498 -> 25fa229ed


Merge pull request #112 from kayousterhout/ui_task_attempt_id

Display both task ID and task attempt ID in UI, and rename taskId to taskAttemptId

Previously only the task attempt ID was shown in the UI; this was confusing because the job
can be shown as complete while there are tasks still running.  Showing the task ID in addition
to the attempt ID makes it clear which tasks are redundant.

This commit also renames taskId to taskAttemptId in TaskInfo and in the local/cluster schedulers.
 This identifier was used to uniquely identify attempts, not tasks, so the current naming
was confusing.  The new naming is also more consistent with map reduce.

(cherry picked from commit aec9bf90606839a5f8ba58ad72af4fafc9efad76)
Signed-off-by: Reynold Xin <rxin@apache.org>


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/25fa229e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/25fa229e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/25fa229e

Branch: refs/heads/branch-0.8
Commit: 25fa229ed8513fbfe5d674d64d17825adbcf3f05
Parents: 57ea854
Author: Matei Zaharia <matei@eecs.berkeley.edu>
Authored: Sun Oct 27 19:32:00 2013 -0700
Committer: Reynold Xin <rxin@apache.org>
Committed: Sun Nov 3 23:41:19 2013 -0800

----------------------------------------------------------------------
 core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/25fa229e/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala b/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala
index 0dd5723..35b5d5f 100644
--- a/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala
+++ b/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala
@@ -83,8 +83,8 @@ private[spark] class StagePage(parent: JobProgressUI) {
         </div>
 
       val taskHeaders: Seq[String] =
-        Seq("Task ID", "Status", "Locality Level", "Executor", "Launch Time", "Duration")
++
-        Seq("GC Time") ++
+        Seq("Task Index", "Task ID", "Status", "Locality Level", "Executor", "Launch Time")
++
+        Seq("Duration", "GC Time") ++
         {if (hasShuffleRead) Seq("Shuffle Read")  else Nil} ++
         {if (hasShuffleWrite) Seq("Write Time", "Shuffle Write") else Nil} ++
         Seq("Errors")
@@ -153,6 +153,7 @@ private[spark] class StagePage(parent: JobProgressUI) {
     val gcTime = metrics.map(m => m.jvmGCTime).getOrElse(0L)
 
     <tr>
+      <td>{info.index}</td>
       <td>{info.taskId}</td>
       <td>{info.status}</td>
       <td>{info.taskLocality}</td>


Mime
View raw message