spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "peay (JIRA)" <>
Subject [jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values
Date Fri, 01 Mar 2019 11:20:00 GMT


peay commented on SPARK-27019:

Also seeing this both for the Spark UI for live jobs, and when accessing past jobs through
the Spark History Server.

> Spark UI's SQL tab shows inconsistent values
> --------------------------------------------
>                 Key: SPARK-27019
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL, Web UI
>    Affects Versions: 2.4.0
>            Reporter: peay
>            Priority: Major
>         Attachments: screenshot-spark-ui-details.png, screenshot-spark-ui-list.png
> Since 2.4.0, I am frequently seeing broken outputs in the SQL tab of the Spark UI, where
submitted/duration make no sense, description has the ID instead of the actual description.
> Clicking on the link to open a query, the SQL plan is missing as well.
> I have tried to increase `spark.scheduler.listenerbus.eventqueue.capacity` to very large
values like 30k out of paranoia that we may have too many events, but to no avail. I have
not identified anything particular that leads to that: it doesn't occur in all my jobs, but
it does occur in a lot of them still.
> !image-2019-03-01-12-05-40-119.png!
> !image-2019-03-01-12-06-48-707.png!

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message