spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ABHISHEK KUMAR GUPTA (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-25503) [Spark Job History] Total task message in stage page is ambiguous
Date Fri, 21 Sep 2018 10:04:00 GMT
ABHISHEK KUMAR GUPTA created SPARK-25503:
--------------------------------------------

             Summary: [Spark Job History] Total task message in stage page is ambiguous
                 Key: SPARK-25503
                 URL: https://issues.apache.org/jira/browse/SPARK-25503
             Project: Spark
          Issue Type: Bug
          Components: Web UI
    Affects Versions: 2.3.1
            Reporter: ABHISHEK KUMAR GUPTA


*Steps:*
 1. Spark installed and running properly.
 2. spark.ui.retainedTask=100000 ( it is default value )
 3.Launch Spark shell ./spark-shell --master yarn
 4. Create a spark-shell application with a single job and 500000 task
 val rdd = sc.parallelize(1 to 500000, 500000)
 rdd.count
 5. Launch Job History Page and go to spark-shell application created above under Incomplete
Task
 6. Right click and got to Job page of the application and from there click and launch Stage
Page
 7. Launch the Stage Id page for the specific Stage Id for the above created job
 8. Scroll down and check for the task msg above Pagination Panel
 It Displays *Task( 100000, Showing 500000)*

*Actual Result:*
 It displayed Task( 100000, Showing 500000)

*Expected Result:*
 Since retainedTask=100000 and it should show 100000 task
 So message should be Task( 500000, Showing 100000)
  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message