hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3916) various issues with running yarn proxyserver
Date Fri, 30 Mar 2012 13:48:26 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13242338#comment-13242338
] 

Hudson commented on MAPREDUCE-3916:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #1954 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1954/])
    MAPREDUCE-3916. various issues with running yarn proxyserver (devaraj via tucu) (Revision
1307413)

     Result = SUCCESS
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1307413
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/proxy
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/proxy/.keep
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml

                
> various issues with running yarn proxyserver
> --------------------------------------------
>
>                 Key: MAPREDUCE-3916
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3916
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, resourcemanager, webapps
>    Affects Versions: 0.23.1, 2.0.0, 3.0.0
>            Reporter: Roman Shaposhnik
>            Assignee: Devaraj K
>            Priority: Critical
>              Labels: mrv2
>             Fix For: 2.0.0
>
>         Attachments: MAPREDUCE-3916.patch
>
>
> Seem like yarn proxyserver is not operational when running out of the 0.23.1 RC2 tarball.
> # Setting yarn.web-proxy.address to match yarn.resourcemanager.address doesn't disable
the proxyserver (althought not setting yarn.web-proxy.address at all correctly disable it
and produces a message: org.apache.hadoop.yarn.YarnException: yarn.web-proxy.address is not
set so the proxy will not run). This contradicts the documentation provided for yarn.web-proxy.address
in yarn-default.xml
> # Setting yarn.web-proxy.address and running the service results in the following:
> {noformat}
> $ ./sbin/yarn-daemon.sh start proxyserver 
> starting proxyserver, logging to /tmp/hadoop-0.23.1/logs/yarn-rvs-proxyserver-ahmed-laptop.out
> /usr/java/64/jdk1.6.0_22/bin/java -Dproc_proxyserver -Xmx1000m -Dhadoop.log.dir=/tmp/hadoop-0.23.1/logs
-Dyarn.log.dir=/tmp/hadoop-0.23.1/logs -Dhadoop.log.file=yarn-rvs-proxyserver-ahmed-laptop.log
-Dyarn.log.file=yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.home.dir= -Dyarn.id.str=rvs -Dhadoop.root.logger=INFO,DRFA
-Dyarn.root.logger=INFO,DRFA -Djava.library.path=/tmp/hadoop-0.23.1/lib/native -Dyarn.policy.file=hadoop-policy.xml
-Dhadoop.log.dir=/tmp/hadoop-0.23.1/logs -Dyarn.log.dir=/tmp/hadoop-0.23.1/logs -Dhadoop.log.file=yarn-rvs-proxyserver-ahmed-laptop.log
-Dyarn.log.file=yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.home.dir=/tmp/hadoop-0.23.1 -Dhadoop.root.logger=INFO,DRFA
-Dyarn.root.logger=INFO,DRFA -Djava.library.path=/tmp/hadoop-0.23.1/lib/native -classpath
/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/share/hadoop/common/lib/*:/tmp/hadoop-0.23.1/share/hadoop/common/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs:/tmp/hadoop-0.23.1/share/hadoop/hdfs/lib/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/lib/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/lib/*
org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer
> {noformat}
> with the following message found in the logs:
> {noformat}
> 2012-02-24 09:26:31,099 FATAL org.apache.hadoop.yarn.server.webproxy.WebAppProxy: Could
not start proxy web server
> java.io.FileNotFoundException: webapps/proxy not found in CLASSPATH
>         at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:532)
>         at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:224)
>         at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:164)
>         at org.apache.hadoop.yarn.server.webproxy.WebAppProxy.start(WebAppProxy.java:85)
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>         at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.main(WebAppProxyServer.java:76)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message