spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "peay (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values
Date Fri, 01 Mar 2019 11:41:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781595#comment-16781595
] 

peay edited comment on SPARK-27019 at 3/1/19 11:40 AM:
-------------------------------------------------------

I don't really have a minimal example - this uses a bunch of python jobs and/or interactive
work in notebooks. Is there a way I could collect debug information to help troubleshooting
this?


was (Author: peay):
I don't really have a minimal example - this uses a bunch of python jobs and/or interactive
works in notebook. Is there a way I could collect debug information to help troubleshooting
this?

> Spark UI's SQL tab shows inconsistent values
> --------------------------------------------
>
>                 Key: SPARK-27019
>                 URL: https://issues.apache.org/jira/browse/SPARK-27019
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL, Web UI
>    Affects Versions: 2.4.0
>            Reporter: peay
>            Priority: Major
>         Attachments: screenshot-spark-ui-details.png, screenshot-spark-ui-list.png
>
>
> Since 2.4.0, I am frequently seeing broken outputs in the SQL tab of the Spark UI, where
submitted/duration make no sense, description has the ID instead of the actual description.
> Clicking on the link to open a query, the SQL plan is missing as well.
> I have tried to increase `spark.scheduler.listenerbus.eventqueue.capacity` to very large
values like 30k out of paranoia that we may have too many events, but to no avail. I have
not identified anything particular that leads to that: it doesn't occur in all my jobs, but
it does occur in a lot of them still.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message