hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahesh Babu <jmb...@gmail.com>
Subject Re: Error - Messages must never be behind the vertex in ID! Current Message ID: 2 vs. 20
Date Fri, 09 Aug 2013 08:40:29 GMT
Hi Anastasis,

Thanks for the reply.

I believe the input is okay. I am able to run the input files in standalone
(eclipse) mode as unit-test. This time I copied them into HDFS and running
through hama-examples<x>.jar file.

No i do not have hama.check.missing.vertex in my configurations.

After your email I set the hama-site.xml with
  <property>
    <name>hama.check.missing.vertex</name>
    <value>true</value>
  </property>

Now I get partition error: (with hama.check.missing.vertex set in
hama-site.xml)
13/08/09 14:03:49 INFO bsp.FileInputFormat: Total input paths to process : 1
13/08/09 14:03:50 INFO bsp.BSPJobClient: Running job: job_201308091403_0002
13/08/09 14:03:53 INFO bsp.BSPJobClient: Current supersteps number: 0
*13/08/09 14:03:53 INFO bsp.BSPJobClient: Job failed.
13/08/09 14:03:53 ERROR bsp.BSPJobClient: Error partitioning the input path.
*
*java.io.IOException: Runtime partition failed for the job.*
*    at org.apache.hama.bsp.BSPJobClient.partition(BSPJobClient.java:465)*
    at
org.apache.hama.bsp.BSPJobClient.submitJobInternal(BSPJobClient.java:333)
    at org.apache.hama.bsp.BSPJobClient.submitJob(BSPJobClient.java:293)
    at org.apache.hama.bsp.BSPJob.submit(BSPJob.java:229)
    at org.apache.hama.graph.GraphJob.submit(GraphJob.java:203)
    at org.apache.hama.bsp.BSPJob.waitForCompletion(BSPJob.java:236)
    at org.apache.hama.examples.SSSP.main(SSSP.java:166)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)

Any clues.. It is quite large file, so I have to find a way to identify
missing vertex.

Regards,
Mahesh Babu




On Fri, Aug 9, 2013 at 1:08 PM, andronat_asf <andronat_asf@hotmail.com>wrote:

> Hello Mahesh,
>
> 1) Do you have hama.check.missing.vertex = true flag in any of your
> configurations?
> 2) Are you sure that your input is ok? e.g. edges to non existing vertices?
>
> Cheers,
> Anastasis Andronidis
>
> On 9 Αυγ 2013, at 9:43 π.μ., Mahesh Babu <jmbabu@gmail.com> wrote:
>
> > Hi,
> >
> > adding more details about the environment.
> >
> > When I run hama-examples-0.6.2.jar with tutorial example/input (berlin
> example) file it works without any error.
> >
> > Now when I try my own input file which has approximately 10k nodes  and
> 39k edges but it fails with:
> >        java.lang.IllegalArgumentException: Messages must never be behind
> the vertex in ID! Current Message ID: 2 vs. 20
> >
> > What am I doing wrong ?
> >
> > Any help/explanation is appreciated.
> >
> > Regards,
> > Mahesh Babu
> >
> >
> >
> >
> > On Thu, Aug 8, 2013 at 4:25 PM, Mahesh Babu <jmbabu@gmail.com> wrote:
> > Hi,
> >
> > I followed the SSSP example, GraphJob example and getting following
> error:
> >
> > 13/08/08 16:01:57 INFO bsp.BSPJobClient: Current supersteps number: 0
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO mortbay.log:
> Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> org.mortbay.log.Slf4jLog
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
> sync.ZKSyncClient: Initializing ZK Sync Client
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
> sync.ZooKeeperSyncClientImpl: Start connecting to Zookeeper! At localhost/
> 127.0.0.1:61001
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server:
> Starting SocketReader
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server:
> IPC Server Responder: starting
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server:
> IPC Server listener on 61001: starting
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
> message.HadoopMessageManagerImpl:  BSPPeer address:localhost port:61001
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server:
> IPC Server handler 0 on 61001: starting
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
> graph.GraphJobRunner: 4935 vertices are loaded into localhost:61001
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 ERROR bsp.BSPTask:
> Error running bsp setup and bsp function.
> > attempt_201308081548_0005_000000_0: java.lang.IllegalArgumentException:
> Messages must never be behind the vertex in ID! Current Message ID: 2 vs. 20
> > attempt_201308081548_0005_000000_0:     at
> org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
> > attempt_201308081548_0005_000000_0:     at
> org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)
> > attempt_201308081548_0005_000000_0:     at
> org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133)
> > attempt_201308081548_0005_000000_0:     at
> org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177)
> > attempt_201308081548_0005_000000_0:     at
> org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
> > attempt_201308081548_0005_000000_0:     at
> org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262)
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> > attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server:
> Stopping server on 61001
> >
> >
> > What could be the reason I am getting this error.
> >
> > I am able to run the code in eclipse/standalong environment. However,
> when I try to run with hama/hadoop pseudo distribution mode it fails.
> >
> > Thanks,
> > Mahesh Babu
> >
> >
> > <hamaError.txt>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message