hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Boesch <java...@gmail.com>
Subject ProtocolProvider errors On MRv2 Failed to use org.apache.hadoop.mapred.YarnClientProtocolProvider
Date Mon, 28 Nov 2011 18:40:04 GMT
  I set up a pseudo cluster  according to the instructions  here

Initially the randomwriter example worked. But after a crash on the machine
and restarting the services I am getting the errors shown below.

Jps seems to think the processes are running properly:

had@mithril:/shared/hadoop$ jps
7980 JobHistoryServer
7668 NameNode
7821 ResourceManager
7748 DataNode
8021 Jps
7902 NodeManager

$ hadoop jar hadoop-mapreduce-examples-0.23.0.jar  randomwriter -
-Dmapreduce.randomwriter.bytespermap=10000 -Ddfs.blocksize=64m
-Ddfs.block.size=64m -libjars
$YARN_HOME/modules/hadoop-mapreduce-client-jobclient-0.23.0.jar output

2011-11-28 10:23:56,102 WARN  conf.Configuration
(Configuration.java:set(629)) - mapred.used.genericoptionsparser is
deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2011-11-28 10:23:56,158 INFO  ipc.YarnRPC (YarnRPC.java:create(47)) -
Creating YarnRPC for org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC
2011-11-28 10:23:56,162 INFO  mapred.ResourceMgrDelegate
(ResourceMgrDelegate.java:<init>(95)) - Connecting to ResourceManager at /
2011-11-28 10:23:56,163 INFO  ipc.HadoopYarnRPC
(HadoopYarnProtoRPC.java:getProxy(48)) - Creating a HadoopYarnProtoRpc
proxy for protocol interface org.apache.hadoop.yarn.api.ClientRMProtocol
2011-11-28 10:23:56,203 INFO  mapred.ResourceMgrDelegate
(ResourceMgrDelegate.java:<init>(99)) - Connected to ResourceManager at /
2011-11-28 10:23:56,248 INFO  mapreduce.Cluster
(Cluster.java:initialize(116)) - Failed to use
org.apache.hadoop.mapred.YarnClientProtocolProvider due to error:
2011-11-28 10:23:56,250 INFO  mapreduce.Cluster
(Cluster.java:initialize(111)) - Cannot pick
org.apache.hadoop.mapred.LocalClientProtocolProvider as the
ClientProtocolProvider - returned null protocol
2011-11-28 10:23:56,251 INFO  mapreduce.Cluster
(Cluster.java:initialize(111)) - Cannot pick
org.apache.hadoop.mapred.JobTrackerClientProtocolProvider as the
ClientProtocolProvider - returned null protocol
java.io.IOException: Cannot initialize Cluster. Please check your
configuration for mapreduce.framework.name and the correspond server

My  *-site.xml files are precisely as shown on the instructions page.

In any case copying here the one that is most germane - mapred-site.xml

<?xml version="1.0"?>
<?xml-stylesheet href="configuration.xsl"?>
<name> mapreduce.framework.name</name>

View raw message