spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jinhua Fu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist
Date Thu, 04 May 2017 09:40:04 GMT

     [ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jinhua Fu updated SPARK-20591:
------------------------------
    Description: 
when spark.speculation is enabled,and there are some speculative tasks, then we can see succeeded
tasks num include speculative tasks on the job page, which however not being included on the
job detail page(job stages page).
When I consider some tasks may run a little slow by the job page's  succeeded tasks more than
total tasks,which make me want to known which tasks and why,I have to check every stage to
find the speculative tasks which is beacause speculative tasks not being included in the stage
succeeded task num.
Can it be improved?

update two screenshots, succeeded task num is 557 on job page,but 550(by sum) on job detail
page(stages),the extra 7 tasks are speculative tasks. 

  was:
when spark.speculation is enabled,and there are some speculative tasks, then we can see succeeded
tasks num include speculative tasks on the job page, which however not being included on the
job detail page(job stages page).
When I consider some tasks may run a little slow by the job page's  succeeded tasks more than
total tasks,which make me want to known which tasks and why,I have to check every stage to
find the speculative tasks which is beacause speculative tasks not being included in the stage
succeeded task num.
Can it be improved?


> Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative
task(s) exist
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-20591
>                 URL: https://issues.apache.org/jira/browse/SPARK-20591
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>    Affects Versions: 2.0.2
>            Reporter: Jinhua Fu
>            Priority: Minor
>         Attachments: job detail page(stages).png, job page.png
>
>
> when spark.speculation is enabled,and there are some speculative tasks, then we can see
succeeded tasks num include speculative tasks on the job page, which however not being included
on the job detail page(job stages page).
> When I consider some tasks may run a little slow by the job page's  succeeded tasks more
than total tasks,which make me want to known which tasks and why,I have to check every stage
to find the speculative tasks which is beacause speculative tasks not being included in the
stage succeeded task num.
> Can it be improved?
> update two screenshots, succeeded task num is 557 on job page,but 550(by sum) on job
detail page(stages),the extra 7 tasks are speculative tasks. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message