Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 85AD49F67 for ; Fri, 30 Mar 2012 13:44:50 +0000 (UTC) Received: (qmail 32351 invoked by uid 500); 30 Mar 2012 13:44:50 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 32299 invoked by uid 500); 30 Mar 2012 13:44:50 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 32226 invoked by uid 99); 30 Mar 2012 13:44:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Mar 2012 13:44:50 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Mar 2012 13:44:48 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id D2A1E34F150 for ; Fri, 30 Mar 2012 13:44:28 +0000 (UTC) Date: Fri, 30 Mar 2012 13:44:28 +0000 (UTC) From: "Alejandro Abdelnur (Updated) (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <60511637.37815.1333115068874.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <709140516.16063.1330107828926.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (MAPREDUCE-3916) various issues with running yarn proxyserver MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-3916?page=3Dcom.atla= ssian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated MAPREDUCE-3916: ------------------------------------------ Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0, 3.0.0 (was: 3.0.0, 2.0.0) Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks Devaraj. I had to manually create the proxy/.keep file as the patch = command ignored it. Committed to trunk and branch-2 =20 > various issues with running yarn proxyserver > -------------------------------------------- > > Key: MAPREDUCE-3916 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3916 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2, resourcemanager, webapps > Affects Versions: 0.23.1, 2.0.0, 3.0.0 > Reporter: Roman Shaposhnik > Assignee: Devaraj K > Priority: Critical > Labels: mrv2 > Fix For: 2.0.0 > > Attachments: MAPREDUCE-3916.patch > > > Seem like yarn proxyserver is not operational when running out of the 0.2= 3.1 RC2 tarball. > # Setting yarn.web-proxy.address to match yarn.resourcemanager.address do= esn't disable the proxyserver (althought not setting yarn.web-proxy.address= at all correctly disable it and produces a message: org.apache.hadoop.yarn= .YarnException: yarn.web-proxy.address is not set so the proxy will not run= ). This contradicts the documentation provided for yarn.web-proxy.address i= n yarn-default.xml > # Setting yarn.web-proxy.address and running the service results in the f= ollowing: > {noformat} > $ ./sbin/yarn-daemon.sh start proxyserver=20 > starting proxyserver, logging to /tmp/hadoop-0.23.1/logs/yarn-rvs-proxyse= rver-ahmed-laptop.out > /usr/java/64/jdk1.6.0_22/bin/java -Dproc_proxyserver -Xmx1000m -Dhadoop.l= og.dir=3D/tmp/hadoop-0.23.1/logs -Dyarn.log.dir=3D/tmp/hadoop-0.23.1/logs -= Dhadoop.log.file=3Dyarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.log.file=3D= yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.home.dir=3D -Dyarn.id.str=3Drv= s -Dhadoop.root.logger=3DINFO,DRFA -Dyarn.root.logger=3DINFO,DRFA -Djava.li= brary.path=3D/tmp/hadoop-0.23.1/lib/native -Dyarn.policy.file=3Dhadoop-poli= cy.xml -Dhadoop.log.dir=3D/tmp/hadoop-0.23.1/logs -Dyarn.log.dir=3D/tmp/had= oop-0.23.1/logs -Dhadoop.log.file=3Dyarn-rvs-proxyserver-ahmed-laptop.log -= Dyarn.log.file=3Dyarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.home.dir=3D/t= mp/hadoop-0.23.1 -Dhadoop.root.logger=3DINFO,DRFA -Dyarn.root.logger=3DINFO= ,DRFA -Djava.library.path=3D/tmp/hadoop-0.23.1/lib/native -classpath /tmp/h= adoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/et= c/hadoop:/tmp/hadoop-0.23.1/share/hadoop/common/lib/*:/tmp/hadoop-0.23.1/sh= are/hadoop/common/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs:/tmp/hadoop-0.23.1= /share/hadoop/hdfs/lib/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs/*:/tmp/hadoop= -0.23.1/share/hadoop/mapreduce/lib/*:/tmp/hadoop-0.23.1/share/hadoop/mapred= uce/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/*:/tmp/hadoop-0.23.1/share/= hadoop/mapreduce/lib/* org.apache.hadoop.yarn.server.webproxy.WebAppProxySe= rver > {noformat} > with the following message found in the logs: > {noformat} > 2012-02-24 09:26:31,099 FATAL org.apache.hadoop.yarn.server.webproxy.WebA= ppProxy: Could not start proxy web server > java.io.FileNotFoundException: webapps/proxy not found in CLASSPATH > at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.ja= va:532) > at org.apache.hadoop.http.HttpServer.(HttpServer.java:224) > at org.apache.hadoop.http.HttpServer.(HttpServer.java:164) > at org.apache.hadoop.yarn.server.webproxy.WebAppProxy.start(WebAp= pProxy.java:85) > at org.apache.hadoop.yarn.service.CompositeService.start(Composit= eService.java:68) > at org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.main(= WebAppProxyServer.java:76) > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs: https://issues.apache.org/jira/secure/ContactAdministrators!default.jsp= a For more information on JIRA, see: http://www.atlassian.com/software/jira