giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eli Reisman <apache.mail...@gmail.com>
Subject Re:
Date Sun, 16 Mar 2014 20:11:32 GMT
It looks like you were able to get an ApplicationMaster to run on your YARN
cluster, but when it requested some containers for actual Giraph
master/worker tasks, it died. Could your YARN cluster configs? Could be
permissions issue too if you're running a local job.


On Tue, Mar 4, 2014 at 3:36 PM, Rocky Grey <rockygrey@gmail.com> wrote:

> Hi Liannet,
>
> Were you able to run giraph program in Hadoop 2.2.0? Seems like running it
> in Hadoop 2.2.0 is a challenge. May be if some one who has success running
> in 2.2.0 can update the documentation that would be very helpful. Lot of
> people are having similar issues.
>
>
> On Tue, Mar 4, 2014 at 12:36 PM, Liannet Reyes <liannetrh@gmail.com>wrote:
>
>> Have you tried this link
>> https://giraph.apache.org/quick_start.html#qs_section_4 ?
>>
>> I follow that guide step by step and did work!
>>
>> good luck!
>>
>>
>>
>>
>>
>> 2014-03-04 18:46 GMT+01:00 Jyoti Yadav <rao.jyoti26yadav@gmail.com>:
>>
>> Hi Giraph Experts..
>>>
>>> I am just new to hadoop 2.2.0.. I am not able to compile even sample
>>> example.
>>>
>>> I gave following command.
>>>
>>>
>>> hadoop jar
>>> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
>>> org.apache.giraph.GiraphRunner -Dgiraph.zkList=127.0.0.1:2181 -libjars
>>> /home/hadoopAdmin/hadoop/giraph-1.0.0/giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar
>>> org.apache.giraph.examples.SimpleShortestPathsComputation -vif
>>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat
>>> -vip /user/nitw-jyothi/graphInput/input -vof
>>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
>>> /user/nitw-jyothi/goutput2/shortestpathsC2 -ca
>>> SimpleShortestPathsVertex.source=2 -w 2
>>>
>>>
>>>  And following error is thrownn..
>>>
>>> INFO yarn.GiraphYarnClient: GiraphApplicationMaster container request
>>> was submitted to ResourceManager for job: Giraph:
>>> org.apache.giraph.examples.SimpleShortestPathsComputation
>>> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient: Giraph:
>>> org.apache.giraph.examples.SimpleShortestPathsComputation, Elapsed: 0.84
>>> secs
>>> 14/03/04 22:53:11 INFO yarn.GiraphYarnClient:
>>> appattempt_1393923555664_0021_000001, State: ACCEPTED, Containers used: 1
>>> 14/03/04 22:53:13
>>> * ERROR yarn.GiraphYarnClient: Giraph:
>>> org.apache.giraph.examples.SimpleShortestPathsComputation reports FAILED
>>> state, diagnostics show: Application application_1393923555664_0021 failed
>>> 2 times due to AM Container for appattempt_1393923555664_0021_000002 exited
>>> with  exitCode: 1 due to: Exception from container-launch:
>>> org.apache.hadoop.util.Shell$ExitCodeException: *
>>>     at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
>>>     at org.apache.hadoop.util.Shell.run(Shell.java:379)
>>>     at
>>> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
>>>     at
>>> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>>>     at
>>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>>>     at
>>> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>>>     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>>     at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>     at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>     at java.lang.Thread.run(Thread.java:744)
>>>
>>>
>>> .Failing this attempt.. Failing the application.
>>> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Cleaning up HDFS
>>> distributed cache directory for Giraph job.
>>> 14/03/04 22:53:13 INFO yarn.GiraphYarnClient: Completed Giraph:
>>> org.apache.giraph.examples.SimpleShortestPathsComputation: FAILED, total
>>> running time: 0 minutes, 3 seconds.
>>>
>>>
>>> Can anyone give me a pointer to fix this..
>>>
>>> Thanks..
>>> Jyoti
>>>
>>
>>
>

Mime
View raw message