giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tripti Singh <tri...@yahoo-inc.com>
Subject Re: Help with Giraph on Yarn
Date Wed, 05 Nov 2014 17:17:38 GMT
I faced the similar problem where the workflow just hangs.
Can u see in ur logs if there is a task with id 0.
I made a local fix and I could give u the patch if u see a similar problem and ur workflow
is unable to find the zookeeper manager file and repeats the following message:
For task xyz, got file 'null'

Thanks,
Tripti
Sent from my iPhone

On 05-Nov-2014, at 10:40 pm, "Alessandro Negro" <alenegro81@yahoo.it<mailto:alenegro81@yahoo.it>>
wrote:

Hi,
have you seen the hadoop logs?
Could you write here how are you running the command?

Thanks,
Alessandro

Il giorno 05/nov/2014, alle ore 18:04, Jing Fan <fanjing09@gmail.com<mailto:fanjing09@gmail.com>>
ha scritto:

Yeah, I add -yj option. The result is the same. Still error here.

On Wed, Nov 5, 2014 at 10:52 AM, Alessandro Negro <alenegro81@yahoo.it<mailto:alenegro81@yahoo.it>>
wrote:
Hi Jing,
I’m facing the same problem. Do you check the hadoop logs? In my case I got:

Could not find or load main class org.apache.giraph.yarn.GiraphApplicationMaster


Moreover I don’t know why my application hang for a long time here:

14/11/05 17:11:17 INFO yarn.YarnUtils: base path checking .

And then continue failing with your error into the output and the other into the hadoop logs.

Did you test adding this?

-yj /Users/ale/extprj/giraph/giraph-core/target/giraph-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar

Thanks,
Alessandro


Il giorno 05/nov/2014, alle ore 17:32, Jing Fan <fanjing09@gmail.com<mailto:fanjing09@gmail.com>>
ha scritto:

Hi,

I install the Giraph with Yarn.
But when I run the program with following command:

 hadoop jar giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.0-cdh5.2.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif
org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/j/tiny_graph.txt
-vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /user/j/shortestpaths -w
1

The program exited with error:

14/11/05 10:25:14 INFO yarn.GiraphYarnClient: Giraph: org.apache.giraph.examples.SimpleShortestPathsComputation,
Elapsed: 0.83 secs
14/11/05 10:25:14 INFO yarn.GiraphYarnClient: appattempt_1415203231170_0002_000001, State:
ACCEPTED, Containers used: 0
14/11/05 10:25:18 INFO yarn.GiraphYarnClient: Giraph: org.apache.giraph.examples.SimpleShortestPathsComputation,
Elapsed: 4.84 secs
14/11/05 10:25:18 INFO yarn.GiraphYarnClient: appattempt_1415203231170_0002_000001, State:
ACCEPTED, Containers used: 0
14/11/05 10:25:22 INFO yarn.GiraphYarnClient: Giraph: org.apache.giraph.examples.SimpleShortestPathsComputation,
Elapsed: 8.85 secs
14/11/05 10:25:22 INFO yarn.GiraphYarnClient: appattempt_1415203231170_0002_000002, State:
ACCEPTED, Containers used: 0
14/11/05 10:25:26 INFO yarn.GiraphYarnClient: Giraph: org.apache.giraph.examples.SimpleShortestPathsComputation,
Elapsed: 12.86 secs
14/11/05 10:25:26 INFO yarn.GiraphYarnClient: appattempt_1415203231170_0002_000002, State:
ACCEPTED, Containers used: 0
14/11/05 10:25:29 ERROR yarn.GiraphYarnClient: Giraph: org.apache.giraph.examples.SimpleShortestPathsComputation
reports FAILED state, diagnostics show: Application application_1415203231170_0002 failed
2 times due to AM Container for appattempt_1415203231170_0002_000002 exited with  exitCode:
1 due to: Exception from container-launch.
Container id: container_1415203231170_0002_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:196)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)


Anyone can help?





Mime
View raw message