giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koontz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-601) Exception when running pagerank benchmark: SendVertexRequest cannot be cast to MasterRequest
Date Fri, 29 Mar 2013 19:45:16 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13617648#comment-13617648
] 

Eugene Koontz commented on GIRAPH-601:
--------------------------------------

All containers *except one* are able to finish their client messages:

{code}
2013-03-29 12:35:49,934 INFO [main] org.apache.giraph.worker.BspServiceWorker: loadInputSplits:
Using 1 thread(s), originally 1 threads(s) for 6 total splits.
2013-03-29 12:35:49,938 INFO [main] org.apache.giraph.comm.SendPartitionCache: SendPartitionCache:
maxVerticesPerTransfer = 10000
2013-03-29 12:35:49,938 INFO [main] org.apache.giraph.comm.SendPartitionCache: SendPartitionCache:
maxEdgesPerTransfer = 80000
2013-03-29 12:35:49,949 INFO [load-0] org.apache.giraph.worker.InputSplitsCallable: call:
Loaded 0 input splits in 0.015249 secs, (v=0, e=0) 0.0 vertices/sec, 0.0 edges/sec
2013-03-29 12:35:49,951 INFO [main] org.apache.giraph.comm.netty.NettyClient: waitAllRequests:
Finished all requests. MBytes/sec sent = 0, MBytes/sec received = 0, MBytesSent = 0, MBytesReceived
= 0, ave sent req MBytes = 0, ave received req MBytes = 0, secs waited = 2.807
2013-03-29 12:35:49,952 INFO [main] org.apache.giraph.worker.BspServiceWorker: setup: Finally
loaded a total of (v=0, e=0)
{code}

.. but this one container never finishes its open requests:

{code}
2013-03-29 12:37:34,988 INFO [main] org.apache.giraph.comm.netty.NettyClient: logInfoAboutOpenRequests:
Waiting for request (destTask=0,reqId=0) - (reqId=0,destAddr=Eugenes-MacBook-Pro.local:30000,elapsedNanos=105029398000,started=Fri
Mar 29 12:35:49 PDT 2013,writeDone=true,writeSuccess=true)
2013-03-29 12:37:34,988 INFO [main] org.apache.giraph.comm.netty.NettyClient: logInfoAboutOpenRequests:
1 requests for taskId=0, 
{code}



                
> Exception when running pagerank benchmark: SendVertexRequest cannot be cast to MasterRequest
> --------------------------------------------------------------------------------------------
>
>                 Key: GIRAPH-601
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-601
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Eugene Koontz
>
> Building Giraph with:
> {code}
> mvn -DskipTests  -Phadoop_2.0.3 clean compile
> {code}
> Running pagerank like this:
> {code}
>  $HADOOP_RUNTIME/bin/hadoop jar $JAR \
>          org.apache.giraph.benchmark.PageRankBenchmark \
> 	  -e 10 -s 10 -v -V 10 -w 6
> {code}
> I see this in  /tmp/userlogs/application_1364578380737_0003/container_1364578380737_0003_01_000002/
:
> {code}
> 2013-03-29 10:58:06,371 DEBUG [org.apache.giraph.master.MasterThread] org.apache.giraph.master.BspServiceMaster:
barrierOnWorkerList: Got finished worker list = [Eugenes-MacBook-Pro.local_1, Eugenes-MacBook-Pro.local_3],
size = 2, worker list = [Worker(hostname=Eugenes-MacBook-Pro.local, MRtaskID=2, port=30002),
Worker(hostname=Eugenes-MacBook-Pro.local, MRtaskID=1, port=30001), Worker(hostname=Eugenes-MacBook-Pro.local,
MRtaskID=4, port=30004), Worker(hostname=Eugenes-MacBook-Pro.local, MRtaskID=3, port=30003),
Worker(hostname=Eugenes-MacBook-Pro.local, MRtaskID=5, port=30005), Worker(hostname=Eugenes-MacBook-Pro.local,
MRtaskID=0, port=30010)], size = 6 from /_hadoopBsp/job_1364578380737_0003/_vertexInputSplitDoneDir
> 2013-03-29 10:58:06,373 WARN [netty-server-exec-3] org.apache.giraph.comm.netty.handler.RequestServerHandler:
exceptionCaught: Channel failed with remote address /172.16.175.1:56236
> java.lang.ClassCastException: org.apache.giraph.comm.requests.SendVertexRequest cannot
be cast to org.apache.giraph.comm.requests.MasterRequest
> 	at org.apache.giraph.comm.netty.handler.MasterRequestServerHandler.processRequest(MasterRequestServerHandler.java:27)
> 	at org.apache.giraph.comm.netty.handler.RequestServerHandler.messageReceived(RequestServerHandler.java:106)
> 	at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296)
> 	at org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:71)
> 	at org.jboss.netty.handler.execution.ChannelUpstreamEventRunnable.doRun(ChannelUpstreamEventRunnable.java:45)
> 	at org.jboss.netty.handler.execution.ChannelEventRunnable.run(ChannelEventRunnable.java:69)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> 	at java.lang.Thread.run(Thread.java:680)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message