spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pablo Langa Blanco (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app
Date Mon, 07 Jan 2019 21:19:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-24701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736366#comment-16736366
] 

Pablo Langa Blanco commented on SPARK-24701:
--------------------------------------------

Hi [~toopt4]

i think you have this functionality in the history server. For each application spark starts
new server (in a new port) and you have the history server up only in one port monitoring
all the applications.

As you can see ([https://spark.apache.org/docs/latest/monitoring.html)] "The history server
displays both completed and incomplete Spark jobs"  "Incomplete applications are only updated
intermittently" spark.history.fs.update.interval

it could be a solution for you?

> SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different
ports per app
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-24701
>                 URL: https://issues.apache.org/jira/browse/SPARK-24701
>             Project: Spark
>          Issue Type: Improvement
>          Components: Web UI
>    Affects Versions: 2.3.1
>            Reporter: t oo
>            Priority: Major
>              Labels: master, security, ui, web, web-ui
>         Attachments: spark_ports.png
>
>
> Right now the detail for all application ids are shown on a diff port per app id, ie.
4040, 4041, 4042...etc this is problematic for environments with tight firewall settings.
Proposing to allow 4040?appid=1,  4040?appid=2,  4040?appid=3..etc for the master web ui
just like what the History Web UI does.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message