giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marco Aurelio Barbosa Fagnani Lotz <m.a.b.l...@stu12.qmul.ac.uk>
Subject Zookeeper problem when running in Pure Yarn
Date Sat, 20 Jul 2013 17:50:33 GMT
Hello :)

When I run the SinglePageRankComputation example, using the following cmd line:

hadoop jar giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.0.3-alpha-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimplePageRankComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
-vip /input/input.txt -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /outPageRank
-w 1 -mc org.apache.giraph.examples.SimplePageRankComputation\$SimplePageRankMasterCompute

I am getting the following error:

"13/07/20 18:37:57 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable
13/07/20 18:37:58 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your
InputFormat does not require one.
13/07/20 18:37:58 INFO yarn.GiraphYarnClient: Final output path is: hdfs://localhost:9000/outPageRank
13/07/20 18:37:58 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl
is inited.
Exception in thread "main" java.lang.IllegalArgumentException: Giraph on YARN does not currentlysupport
Giraph-managed ZK instances: use a standalone ZooKeeper: 'null'
at org.apache.giraph.yarn.GiraphYarnClient.checkJobLocalZooKeeperSupported(GiraphYarnClient.java:392)
at org.apache.giraph.yarn.GiraphYarnClient.run(GiraphYarnClient.java:106)
at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:96)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:126)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)"


I couldn't fine anything about this Zookeeper error on google, any hints?
Since the PageRankBenchmark is not working on Yarn, what are the examples actually working
on the current versions?

Oh, another thing: Does anyone knows how to remove the:

"13/07/20 18:37:57 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable"

On Hadoop Yarn 2.0.3-alpha?

Best regards,
Marco

Mime
View raw message