hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Devaraj K (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3916) various issues with running yarn proxyserver
Date Fri, 30 Mar 2012 13:46:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13242335#comment-13242335
] 

Devaraj K commented on MAPREDUCE-3916:
--------------------------------------

Thanks a lot Alejandro for reviewing and verifying the patch.

{quote}
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
{quote}

No new tests required because changes done in yarn-default.xml and added one dir.
                
> various issues with running yarn proxyserver
> --------------------------------------------
>
>                 Key: MAPREDUCE-3916
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3916
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, resourcemanager, webapps
>    Affects Versions: 0.23.1, 2.0.0, 3.0.0
>            Reporter: Roman Shaposhnik
>            Assignee: Devaraj K
>            Priority: Critical
>              Labels: mrv2
>             Fix For: 2.0.0
>
>         Attachments: MAPREDUCE-3916.patch
>
>
> Seem like yarn proxyserver is not operational when running out of the 0.23.1 RC2 tarball.
> # Setting yarn.web-proxy.address to match yarn.resourcemanager.address doesn't disable
the proxyserver (althought not setting yarn.web-proxy.address at all correctly disable it
and produces a message: org.apache.hadoop.yarn.YarnException: yarn.web-proxy.address is not
set so the proxy will not run). This contradicts the documentation provided for yarn.web-proxy.address
in yarn-default.xml
> # Setting yarn.web-proxy.address and running the service results in the following:
> {noformat}
> $ ./sbin/yarn-daemon.sh start proxyserver 
> starting proxyserver, logging to /tmp/hadoop-0.23.1/logs/yarn-rvs-proxyserver-ahmed-laptop.out
> /usr/java/64/jdk1.6.0_22/bin/java -Dproc_proxyserver -Xmx1000m -Dhadoop.log.dir=/tmp/hadoop-0.23.1/logs
-Dyarn.log.dir=/tmp/hadoop-0.23.1/logs -Dhadoop.log.file=yarn-rvs-proxyserver-ahmed-laptop.log
-Dyarn.log.file=yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.home.dir= -Dyarn.id.str=rvs -Dhadoop.root.logger=INFO,DRFA
-Dyarn.root.logger=INFO,DRFA -Djava.library.path=/tmp/hadoop-0.23.1/lib/native -Dyarn.policy.file=hadoop-policy.xml
-Dhadoop.log.dir=/tmp/hadoop-0.23.1/logs -Dyarn.log.dir=/tmp/hadoop-0.23.1/logs -Dhadoop.log.file=yarn-rvs-proxyserver-ahmed-laptop.log
-Dyarn.log.file=yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.home.dir=/tmp/hadoop-0.23.1 -Dhadoop.root.logger=INFO,DRFA
-Dyarn.root.logger=INFO,DRFA -Djava.library.path=/tmp/hadoop-0.23.1/lib/native -classpath
/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/share/hadoop/common/lib/*:/tmp/hadoop-0.23.1/share/hadoop/common/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs:/tmp/hadoop-0.23.1/share/hadoop/hdfs/lib/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/lib/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/lib/*
org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer
> {noformat}
> with the following message found in the logs:
> {noformat}
> 2012-02-24 09:26:31,099 FATAL org.apache.hadoop.yarn.server.webproxy.WebAppProxy: Could
not start proxy web server
> java.io.FileNotFoundException: webapps/proxy not found in CLASSPATH
>         at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:532)
>         at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:224)
>         at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:164)
>         at org.apache.hadoop.yarn.server.webproxy.WebAppProxy.start(WebAppProxy.java:85)
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>         at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.main(WebAppProxyServer.java:76)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message