giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kiru Pakkirisamy <kirupakkiris...@yahoo.com>
Subject Re: issues while running giraph on Hadoop 2.2
Date Fri, 16 May 2014 02:56:06 GMT
I have the same issue running giraph built with -Phadoop_yarn -Dhadoop.version=2.2.0 on Hortonworks.
I get classnotfoundexceptions, looks like the GiraphRunner may not be able to load the classes
correctly while running on Yarn.
So if anybody has had success please share your experience, wondering what I have been doing
wrong.

Exception in thread "main" java.lang.ClassNotFoundException: org.apache.giraph.examples.SimpleShortestPathsComputation

 
Regards,
- kiru


________________________________
 From: yeshwanth kumar <yeshwanth43@gmail.com>
To: "user@giraph.apache.org" <user@giraph.apache.org> 
Sent: Thursday, May 8, 2014 4:47 AM
Subject: issues while running giraph on Hadoop 2.2
 


hi i am running Hortonworks hadoop 2.2
trying to run giraph shortest path example.
i am getting this exception



$ hadoop jar giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/hdfs/input/tiny.txt
-vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/hdfs/output/shortestpaths
-w 1
14/05/07 23:45:42 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your
InputFormat does not require one.
14/05/07 23:45:42 INFO utils.ConfigurationUtils: No edge output format specified. Ensure your
OutputFormat does not require one.
14/05/07 23:45:42 INFO yarn.GiraphYarnClient: Final output path is: hdfs://server02.infnet:8020/user/hdfs/output/shortestpaths
14/05/07 23:45:42 INFO yarn.GiraphYarnClient: Running Client
14/05/07 23:45:42 INFO client.RMProxy: Connecting to ResourceManager at server02.infnet/192.168.1.85:8050
14/05/07 23:45:42 INFO yarn.GiraphYarnClient: Defaulting per-task heap size to 1024MB.
Exception in thread "main" java.lang.IllegalStateException: Giraph's estimated cluster heap
2048MB ask is greater than the current available cluster heap of 0MB. Aborting Job.
at org.apache.giraph.yarn.GiraphYarnClient.checkPerNodeResourcesAvailable(GiraphYarnClient.java:230)
at org.apache.giraph.yarn.GiraphYarnClient.run(GiraphYarnClient.java:124)
at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:96)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:126)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)



i am missing some configuration, can someone point me in the right direction.

thanks,
Yeshwanth
Mime
View raw message