Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of Jason_Vasdias@mcafee.com
 designates 161.69.47.167 as permitted sender)
From: <Jason_Vasdias@McAfee.com>
To: <user@hadoop.apache.org>
Subject: RE: meaning of cryptic yarn nodemanager message:
 org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
Thread-Topic: meaning of cryptic yarn nodemanager message:
 org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
Thread-Index: Ac7gbtVkdt0cv0yoSq21ZQd99PAqvw==
Date: Wed, 13 Nov 2013 12:50:14 +0000
Message-ID: <0B3B52A1C5ECD84D84C8A24378DFDB222B3B06@MIVEXEMEA1N1.corp.nai.org>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

RE: meaning of cryptic yarn nodemanager message: org.apache.hadoop.yarn.ser=
ver.nodemanager.containermanager.AuxServices

I answered one of my own questions:
	> Should I change the name be changed to "httpshuffle"  or not ?
When I do change it, I get this error message and nodeserver fails to start=
:

2013-11-13 12:39:06,878 FATAL org.apache.hadoop.yarn.server.nodemanager.con=
tainermanager.AuxServices: Failed to initialize httpshuffle
java.lang.RuntimeException: No class defined for httpshuffle

So the correct name should be 'mapreduce_shuffle' ? =20
Why then the complaint in the log that it is not 'httpshuffle' ?
What issues might be caused by the name being 'mapreduce_shuffle' ?

Thanks & Regards,
Jason

-----Original Message-----
From: VasDias, Jason=20
Sent: 13 November 2013 12:36
To: user-help@hadoop.apache.org
Subject: meaning of cryptic yarn nodemanager message: org.apache.hadoop.yar=
n.server.nodemanager.containermanager.AuxServices

Good day - please could anyone explain the meaning of this message in yarn-=
${USER}-nodemanager-${HOST}.log:

"
2013-11-13 12:17:29,704 WARN org.apache.hadoop.yarn.server.nodemanager.cont=
ainermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' =
in the configuration is for class class org.apache.hadoop.mapred.ShuffleHan=
dler which has a name of 'httpshuffle'. Because these are not the same tool=
s trying to send ServiceData and read Service Meta Data may have issues unl=
ess the refer to the name in the config.
"
Love the creative spelling ! ('Auxilurary' should be 'Auxiliary' ? 'unless =
the refer' should be 'unless they refer' ?)

I guess this is because of the setting in yarn-site.xml :

"
<property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
    <description>shuffle service that needs to be set for Map Reduce to run=
 </description>  </property> "
that I installed according to the instructions at: =20
http://hadoop.apache.org/docs/r2.2.0/hadoop-project-dist/hadoop-common/Sing=
leCluster.html

Why do these instructions specify this setting it may cause "issues" ? What=
 sort of issues may be caused ?=20
This sentence is nonsensical:
  " Because these are not the same tools trying to send ServiceData and rea=
d Service Meta Data may have issues unless the refer to the name in the con=
fig."
What are the "tools" being referred to here ?
What "may have issues" ?
What are the "issues" ?=20
What  must refer to the name in the config ?
Should I change the name to "httpshuffle"  or not ?

Any ideas / suggestions gratefully received.

Regards,
Jason