spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished
Date Thu, 06 Oct 2016 08:12:20 GMT


Sean Owen commented on SPARK-17707:

... why not just call stop()? 
stop() was always what you're supposed to do. Look at the examples in examples/. That example
you cite though does need a fix.

> Web UI prevents spark-submit application to be finished
> -------------------------------------------------------
>                 Key: SPARK-17707
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 2.0.0, 2.0.1
>            Reporter: Nick Orka
> Here are re-production steps:
> 1. create any scala spark application which will work long enough to open the application
details in Web UI
> 2. run spark-submit command for standalone cluster, like: --master spark:\\localhost:7077
> 3. open running application details in Web UI, like: localhost:4040
> 4. spark-submit will never finish, you will have to kill the process
> Cause: The application creates a thread with infinite loop for web UI communication 
and never stops it. The application is waiting for the thread to be finished instead, even
if you close the web page.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message