giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roman Shaposhnik <ro...@shaposhnik.org>
Subject Re: Giraph on Hadoop 2.0.0-alpha
Date Thu, 31 May 2012 17:39:48 GMT
On Tue, May 29, 2012 at 1:25 PM, Avery Ching <aching@apache.org> wrote:
> Did you compile with the appropriate flags?
>
> From the README:
>
> - Apache Hadoop 0.23.1
>
>  You may tell maven to use this version with "mvn -Phadoop_0.23 <goals>".

Did that, but given that I was trying to run against 2.0.0-alpha I also had to
manually adjust the version. Perhaps now that 2.0.0-alpha is out it would
be useful to adjust the giraph profile to bind to that version instead of 0.23.

Anyway, I can now successfully submit the giraph job, but the job can't
complete. In fact I see that 3 maps failed with the following. And the remaining
4 maps just refuse to exit (hence the job hangs).

Does this look like a known issue or should I file a JIRA?

2012-05-31 10:31:28,518 WARN [main]
org.apache.hadoop.mapred.YarnChild: Exception running child :
java.lang.RuntimeException: java.lang.NoSuchFieldException: versionID
	at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:170)
	at org.apache.hadoop.ipc.WritableRpcEngine$Invocation.(WritableRpcEngine.java:110)
	at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:224)
	at $Proxy11.putVertexList(Unknown Source)
	at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:921)
	at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:322)
	at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:594)
	at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:473)
	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:645)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
Caused by: java.lang.NoSuchFieldException: versionID
	at java.lang.Class.getField(Class.java:1520)
	at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:166)
	... 15 more

Thanks,
Roman.

Mime
View raw message