spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-21252) The duration times showed by spark web UI are inaccurate
Date Thu, 29 Jun 2017 09:27:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-21252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068069#comment-16068069
] 

Sean Owen commented on SPARK-21252:
-----------------------------------

They are rounded, and '3 seconds' is unlikely to be exactly 3 seconds,  but maybe "3.49 seconds".
This could explain the rounding you see, but, it's on purpose. The output is for humans and
it's not worth cluttering the display with the extra digits. I don't think this is a problem.

> The duration times showed by spark web UI are inaccurate
> --------------------------------------------------------
>
>                 Key: SPARK-21252
>                 URL: https://issues.apache.org/jira/browse/SPARK-21252
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>    Affects Versions: 2.0.0, 2.0.1, 2.1.0, 2.1.1
>            Reporter: igor mazor
>
> The duration times showed by spark UI are inaccurate and seems to be rounded.
> For example when a job had 2 stages, first stage executed in 47 ms and second stage in
3 seconds, the total execution time showed by the UI is 4 seconds.
> Another example, first stage was executed in 20 ms and second stage in 4 seconds, the
total execution time showed by the UI would be in that case also 4 seconds.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message