spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srinivasa Reddy Vundela (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-11484) Giving precedence to proxyBase set by spark instead of env
Date Wed, 04 Nov 2015 15:45:28 GMT

     [ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Srinivasa Reddy Vundela updated SPARK-11484:
--------------------------------------------
    Description: 
Customer reported a strange UI when running spark application through Oozie in Uber mode (Issue
was observed only in yarn-client mode).

When debugging the sparkUI through chrome developer console, figured out that CSS files are
looked for in different applicationId (Oozie mapreduce application) instead of actual spark
application. (Please see the attached screenshot for more information).

Looking into the live sparkUI code, it seems that proxyBase is taken from APPLICATION_WEB_PROXY_BASE
instead of spark property spark.ui.proxyBase (Pointing to the actual spark application). This
issue might be reproducible if the above specified env is set manually or set by other job.


Fix would be giving precedence to spark property (which might be correct in most cases when
it was set). 

  was:
Customer reported a strange UI when running spark application through Oozie in Uber mode (Issue
was observed only in yarn-client mode).

When debugging the sparkUI through chrome developer console, figured out that CSS files are
looked for in different applicationId (Oozie mapreduce application) instead of actual spark
application. (Please see the attached screenshot for more information).

Looking into the live sparkUI it seems that proxyBase is taken from APPLICATION_WEB_PROXY_BASE
instead of spark property spark.ui.proxyBase (Pointing to the actual spark application). 

This fix gives precedence to spark property (which should be correct in most cases when it
was set), which should fix the issue.


> Giving precedence to proxyBase set by spark instead of env
> ----------------------------------------------------------
>
>                 Key: SPARK-11484
>                 URL: https://issues.apache.org/jira/browse/SPARK-11484
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>            Reporter: Srinivasa Reddy Vundela
>            Priority: Minor
>         Attachments: Screen Shot 2015-10-29 at 9.06.46 AM.png
>
>
> Customer reported a strange UI when running spark application through Oozie in Uber mode
(Issue was observed only in yarn-client mode).
> When debugging the sparkUI through chrome developer console, figured out that CSS files
are looked for in different applicationId (Oozie mapreduce application) instead of actual
spark application. (Please see the attached screenshot for more information).
> Looking into the live sparkUI code, it seems that proxyBase is taken from APPLICATION_WEB_PROXY_BASE
instead of spark property spark.ui.proxyBase (Pointing to the actual spark application). This
issue might be reproducible if the above specified env is set manually or set by other job.

> Fix would be giving precedence to spark property (which might be correct in most cases
when it was set). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message