spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saisai Shao (JIRA)" <>
Subject [jira] [Commented] (SPARK-20772) Add support for query parameters in redirects on Yarn
Date Wed, 17 May 2017 02:48:04 GMT


Saisai Shao commented on SPARK-20772:

I'm guessing if it is an issue of {{AmIpFilter}}, should be a yarn issue, not related to Spark?

> Add support for query parameters in redirects on Yarn
> -----------------------------------------------------
>                 Key: SPARK-20772
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: YARN
>    Affects Versions: 2.1.0
>            Reporter: Bjorn Jonsson
>            Priority: Minor
> Spark uses rewrites of query parameters to paths (http://<fqdn>:4040/jobs/job?id=0
--> http://<fqdn>:4040/jobs/job/?id=0). This works fine in local or standalone mode,
but does not work on Yarn (with the org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
filter), where the query parameter is dropped.
> The repro steps are:
> - Start up the spark-shell and run a job
> - Try to access the job details through http://<fqdn>:4040/jobs/job?id=0
> - A HTTP ERROR 400 is thrown (requirement failed: missing id parameter)
> Going directly through the RM proxy works (does not cause query parameters to be dropped).

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message