giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Martin Neumann <mneum...@spotify.com>
Subject Preconfigured BigTop running Giraph
Date Tue, 07 Jan 2014 13:44:55 GMT
Hej,

I installed Giraph from the apache BigTop
<http://bigtop.apache.org/>project and want to try to run some Giraph
jobs locally on my machine. If I
understood the website correctly it should be preconfigured to do so.
But when I run a Giraph Job I get the following exception:

*Exception in thread "main" java.lang.IllegalStateException: Giraph's
estimated cluster heap 2048MB ask is greater than the current available
cluster heap of 0MB. Aborting Job.*


To me it sounds like a configuration problem, I'm not even sure if it comes
from Giraph or from Yarn. If it is a configuration issue is there help page
that tells you to configure the environment correctly?
Thanks for the help.





here the log of the whole execution:

spotify@spotify-ThinkPad-T430s:~$ giraph
/home/spotify/workspace/GiraphExe/SpotifyConComp.jar
spotifyConnectedComponent.ConComp -eif
spotifyConnectedComponent.ConCompInput -of
spotifyConnectedComponent.ConCompOutput -c
spotifyConnectedComponent.MinTextCombiner -eip
/home/spotify/workspace/GiraphExe/in/sample -op
/home/spotify/workspace/GiraphExe/out/spotifyConnectedComponent.ConComp -w 1
HADOOP_CONF_DIR=/etc/hadoop/conf
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/lib/giraph/lib/slf4j-log4j12-1.7.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
14/01/07 14:40:35 INFO utils.ConfigurationUtils: No vertex input format
specified. Ensure your InputFormat does not require one.
14/01/07 14:40:35 INFO yarn.GiraphYarnClient: Final output path is:
hdfs://localhost:8020/home/spotify/workspace/GiraphExe/out/spotifyConnectedComponent.ConComp
14/01/07 14:40:35 INFO service.AbstractService:
Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited.
14/01/07 14:40:35 INFO service.AbstractService:
Service:org.apache.hadoop.yarn.client.YarnClientImpl is started.
14/01/07 14:40:35 INFO yarn.GiraphYarnClient: Defaulting per-task heap size
to 1024MB.
Exception in thread "main" java.lang.IllegalStateException: Giraph's
estimated cluster heap 2048MB ask is greater than the current available
cluster heap of 0MB. Aborting Job.
    at
org.apache.giraph.yarn.GiraphYarnClient.checkPerNodeResourcesAvailable(GiraphYarnClient.java:204)
    at
org.apache.giraph.yarn.GiraphYarnClient.run(GiraphYarnClient.java:114)
    at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:96)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
    at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:126)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

Mime
View raw message