hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahesh Babu <jmb...@gmail.com>
Subject Re: Error - Messages must never be behind the vertex in ID! Current Message ID: 2 vs. 20
Date Sun, 11 Aug 2013 03:41:44 GMT
Hi Francisco,

Thanks for the detailed reply. I will try this and update back.

In between, is there a way to defer sending messages until all the graph is
created ?

Regards,
Mahesh Babu



On Sun, Aug 11, 2013 at 1:04 AM, Francisco Sanches
<sanchesbanhos@gmail.com>wrote:

> Hi Mahesh Babu
>
> You are trying to send a mesagem for vertex that has not been created yet.
> Note the graph:
>
> # source destination
> 1                   5
> 1                   7
> 2                   1
>
> When the vertex 1 to send a message to the 5 it will give this error
> because the vertex 5 has not yet been created. To fix this would have to
> change to the graph:
>
> # source destination
> 1                  2
> 1                  5
> 1                  7
> 2                  1
> 5                  1
> 7                  1
>
> This should fix the problem. At least when I had this problem I solved
> well. I would recommend you run the example sometimes SSSP hama, and begin
> their work by her.
>
>
> 2013/8/10 Mahesh Babu <jmbabu@gmail.com>
>
> > Hi,
> >
> > My graph definition is as follows:
> >    Vertex<Text, IntWritable, StringIntPairWritable>
> >    VertexInputReader<LongWritable, Text, Text, IntWritable,
> > StringIntPairWritable>
> >           with parseVertex(LongWritable key, Text value, Vertex<Text,
> > IntWritable, StringIntPairWritable> vertex)
> >
> > and hence
> >     setInputKeyClass(LongWritable.class);
> >     setInputValueClass(Text.class);
> >     setOutputKeyClass(Text.class);
> >     setOutputValueClass(StringIntPairWritable.class);
> >
> > I am not sure why I decided InputKey to be LongWritable, just went by one
> > of the examples and this parameter is unused in parseVertex
> implementation.
> >
> > Is there something wrong with my definitions ?
> >
> > StringIntPairWritable is similar to IntIntPairWritable where I wanted the
> > predecessor to be string type.
> >
> > My latest error is:
> > 13/08/10 23:23:53 ERROR bsp.LocalBSPRunner: Exception during BSP
> execution!
> > java.lang.IllegalArgumentException: Messages must never be behind the
> > vertex in ID! Current Message ID: five vs. fivehundredeighty
> >     at
> > org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
> >     at
> > org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)
> >
> >
> > Regards,
> > Mahesh Babu
> >
> >
> >
> > On Fri, Aug 9, 2013 at 8:35 PM, Mahesh Babu <jmbabu@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Can you help me understand:
> > > 1) How to check input graph type
> > > 2) How to debug partition jobs
> > >
> > > Insights would be helpful.
> > >
> > > Regards,
> > > Mahesh Babu
> > >
> > >
> > > On Fri, Aug 9, 2013 at 5:35 PM, Edward J. Yoon <edwardyoon@apache.org
> > >wrote:
> > >
> > >> Hi,
> > >>
> > >> Integer ID (1, 2, ..) should be fine. As other people said, I think
> > >> you need to check the input graph type.
> > >>
> > >> On Fri, Aug 9, 2013 at 8:50 PM, Mahesh Babu <jmbabu@gmail.com> wrote:
> > >> > Hi Edward,
> > >> >
> > >> > I replaced node names from 1 to "one", 6288 to
> > >> > "sixthousandtwohundredeightyeight", etc.
> > >> > I am not getting the error now. so it may be something to do with
> > number
> > >> > itself being the name.
> > >> >
> > >> > Will monitor if I hit at this error once again. For now it is
> working.
> > >> > Proceeding with some more code changes.
> > >> >
> > >> > Thanks,
> > >> > Mahesh Babu
> > >> >
> > >> >
> > >> > On Fri, Aug 9, 2013 at 2:38 PM, Mahesh Babu <jmbabu@gmail.com>
> wrote:
> > >> >
> > >> >> Hi Edward,
> > >> >>
> > >> >> In my case vertices are named with numbers. like 1,2,3...etc
> itself.
> > No
> > >> >> alphabets in the vertex name, it is just 1 to 10000+ nodes
> identified
> > >> by
> > >> >> the number itself.
> > >> >>
> > >> >> You think that could be reason ?
> > >> >>
> > >> >> Regards,
> > >> >> Mahesh Babu
> > >> >>
> > >> >>
> > >> >> On Fri, Aug 9, 2013 at 1:58 PM, Edward J. Yoon <
> > edwardyoon@apache.org
> > >> >wrote:
> > >> >>
> > >> >>> It occurs when the vertices are unsorted.
> > >> >>>
> > >> >>> Please check whether your vertex parser reads correctly, and
> > >> >>> partitioning job was run before the graph job.
> > >> >>>
> > >> >>> On Fri, Aug 9, 2013 at 3:43 PM, Mahesh Babu <jmbabu@gmail.com>
> > wrote:
> > >> >>> > Hi,
> > >> >>> >
> > >> >>> > adding more details about the environment.
> > >> >>> >
> > >> >>> > When I run hama-examples-0.6.2.jar with tutorial example/input
> > >> (berlin
> > >> >>> > example) file it works without any error.
> > >> >>> >
> > >> >>> > Now when I try my own input file which has approximately
10k
> nodes
> > >>  and
> > >> >>> 39k
> > >> >>> > edges but it fails with:
> > >> >>> >
> > >> >>> >        java.lang.IllegalArgumentException: Messages must
never
> be
> > >> >>> behind the
> > >> >>> > vertex in ID! Current Message ID: 2 vs. 20
> > >> >>> >
> > >> >>> > What am I doing wrong ?
> > >> >>> >
> > >> >>> > Any help/explanation is appreciated.
> > >> >>> >
> > >> >>> > Regards,
> > >> >>> > Mahesh Babu
> > >> >>> >
> > >> >>> >
> > >> >>> >
> > >> >>> >
> > >> >>> > On Thu, Aug 8, 2013 at 4:25 PM, Mahesh Babu <jmbabu@gmail.com>
> > >> wrote:
> > >> >>> >>
> > >> >>> >> Hi,
> > >> >>> >>
> > >> >>> >> I followed the SSSP example, GraphJob example and
getting
> > following
> > >> >>> error:
> > >> >>> >>
> > >> >>> >> 13/08/08 16:01:57 INFO bsp.BSPJobClient: Current
supersteps
> > >> number: 0
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> mortbay.log:
> > >> >>> >> Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)
> via
> > >> >>> >> org.mortbay.log.Slf4jLog
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> >>> >> sync.ZKSyncClient: Initializing ZK Sync Client
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> >>> >> sync.ZooKeeperSyncClientImpl: Start connecting to
Zookeeper! At
> > >> >>> >> localhost/127.0.0.1:61001
> > >> >>> >>
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
> > >> >>> >> message.MessageTransferQueueFactory: Message queue
is
> configured
> > on
> > >> >>> >> deprecated parameter:hama.messenger.queue.class
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
> > >> >>> >> message.MessageTransferQueueFactory: Message queue
is
> configured
> > on
> > >> >>> >> deprecated parameter:hama.messenger.queue.class
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> ipc.Server:
> > >> >>> >> Starting SocketReader
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> ipc.Server:
> > >> >>> IPC
> > >> >>> >> Server Responder: starting
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> ipc.Server:
> > >> >>> IPC
> > >> >>> >> Server listener on 61001: starting
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> >>> >> message.HadoopMessageManagerImpl:  BSPPeer address:localhost
> > >> port:61001
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> ipc.Server:
> > >> >>> IPC
> > >> >>> >> Server handler 0 on 61001: starting
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> >>> >> graph.GraphJobRunner: 4935 vertices are loaded into
> > localhost:61001
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
> > >> >>> >> message.MessageTransferQueueFactory: Message queue
is
> configured
> > on
> > >> >>> >> deprecated parameter:hama.messenger.queue.class
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
> > >> >>> >> message.MessageTransferQueueFactory: Message queue
is
> configured
> > on
> > >> >>> >> deprecated parameter:hama.messenger.queue.class
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
> > >> >>> >> message.MessageTransferQueueFactory: Message queue
is
> configured
> > on
> > >> >>> >> deprecated parameter:hama.messenger.queue.class
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
> > >> >>> >> message.MessageTransferQueueFactory: Message queue
is
> configured
> > on
> > >> >>> >> deprecated parameter:hama.messenger.queue.class
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
> > >> >>> >> message.MessageTransferQueueFactory: Message queue
is
> configured
> > on
> > >> >>> >> deprecated parameter:hama.messenger.queue.class
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
ERROR
> > >> >>> bsp.BSPTask:
> > >> >>> >> Error running bsp setup and bsp function.
> > >> >>> >> attempt_201308081548_0005_000000_0:
> > >> java.lang.IllegalArgumentException:
> > >> >>> >> Messages must never be behind the vertex in ID! Current
Message
> > >> ID: 2
> > >> >>> vs. 20
> > >> >>> >> attempt_201308081548_0005_000000_0:     at
> > >> >>> >>
> > >> org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
> > >> >>> >> attempt_201308081548_0005_000000_0:     at
> > >> >>> >>
> > >> >>>
> > >>
> > org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)
> > >> >>> >> attempt_201308081548_0005_000000_0:     at
> > >> >>> >>
> org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133)
> > >> >>> >> attempt_201308081548_0005_000000_0:     at
> > >> >>> >> org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177)
> > >> >>> >> attempt_201308081548_0005_000000_0:     at
> > >> >>> >> org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
> > >> >>> >> attempt_201308081548_0005_000000_0:     at
> > >> >>> >>
> > >> >>>
> > >>
> org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262)
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
WARN
> > >> >>> >> message.MessageTransferQueueFactory: Message queue
is
> configured
> > on
> > >> >>> >> deprecated parameter:hama.messenger.queue.class
> > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49
INFO
> > >> ipc.Server:
> > >> >>> >> Stopping server on 61001
> > >> >>> >>
> > >> >>> >>
> > >> >>> >> What could be the reason I am getting this error.
> > >> >>> >>
> > >> >>> >> I am able to run the code in eclipse/standalong environment.
> > >> However,
> > >> >>> when
> > >> >>> >> I try to run with hama/hadoop pseudo distribution
mode it
> fails.
> > >> >>> >>
> > >> >>> >> Thanks,
> > >> >>> >> Mahesh Babu
> > >> >>> >>
> > >> >>> >
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>> --
> > >> >>> Best Regards, Edward J. Yoon
> > >> >>> @eddieyoon
> > >> >>>
> > >> >>
> > >> >>
> > >>
> > >>
> > >>
> > >> --
> > >> Best Regards, Edward J. Yoon
> > >> @eddieyoon
> > >>
> > >
> > >
> >
>
>
>
> --
> Francisco Sanches
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message