spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "peay (JIRA)" <>
Subject [jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values
Date Fri, 01 Mar 2019 11:11:00 GMT


peay edited comment on SPARK-27019 at 3/1/19 11:10 AM:

Seems like the screenshots did not embed, attaching them instead.

was (Author: peay):
Seems like the screenshot did not embed, attaching them instead.

> Spark UI's SQL tab shows inconsistent values
> --------------------------------------------
>                 Key: SPARK-27019
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL, Web UI
>    Affects Versions: 2.4.0
>            Reporter: peay
>            Priority: Major
>         Attachments: screenshot-spark-ui-details.png, screenshot-spark-ui-list.png
> Since 2.4.0, I am frequently seeing broken outputs in the SQL tab of the Spark UI, where
submitted/duration make no sense, description has the ID instead of the actual description.
> Clicking on the link to open a query, the SQL plan is missing as well.
> I have tried to increase `spark.scheduler.listenerbus.eventqueue.capacity` to very large
values like 30k out of paranoia that we may have too many events, but to no avail. I have
not identified anything particular that leads to that: it doesn't occur in all my jobs, but
it does occur in a lot of them still.
> !image-2019-03-01-12-05-40-119.png!
> !image-2019-03-01-12-06-48-707.png!

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message