spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saisai Shao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-20772) Add support for query parameters in redirects on Yarn
Date Wed, 17 May 2017 02:48:04 GMT

    [ https://issues.apache.org/jira/browse/SPARK-20772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013431#comment-16013431
] 

Saisai Shao commented on SPARK-20772:
-------------------------------------

I'm guessing if it is an issue of {{AmIpFilter}}, should be a yarn issue, not related to Spark?

> Add support for query parameters in redirects on Yarn
> -----------------------------------------------------
>
>                 Key: SPARK-20772
>                 URL: https://issues.apache.org/jira/browse/SPARK-20772
>             Project: Spark
>          Issue Type: Improvement
>          Components: YARN
>    Affects Versions: 2.1.0
>            Reporter: Bjorn Jonsson
>            Priority: Minor
>
> Spark uses rewrites of query parameters to paths (http://<fqdn>:4040/jobs/job?id=0
--> http://<fqdn>:4040/jobs/job/?id=0). This works fine in local or standalone mode,
but does not work on Yarn (with the org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
filter), where the query parameter is dropped.
> The repro steps are:
> - Start up the spark-shell and run a job
> - Try to access the job details through http://<fqdn>:4040/jobs/job?id=0
> - A HTTP ERROR 400 is thrown (requirement failed: missing id parameter)
> Going directly through the RM proxy works (does not cause query parameters to be dropped).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message