hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahesh Babu <jmb...@gmail.com>
Subject Re: Error - Messages must never be behind the vertex in ID! Current Message ID: 2 vs. 20
Date Sat, 10 Aug 2013 18:00:56 GMT
Hi,

My graph definition is as follows:
   Vertex<Text, IntWritable, StringIntPairWritable>
   VertexInputReader<LongWritable, Text, Text, IntWritable,
StringIntPairWritable>
          with parseVertex(LongWritable key, Text value, Vertex<Text,
IntWritable, StringIntPairWritable> vertex)

and hence
    setInputKeyClass(LongWritable.class);
    setInputValueClass(Text.class);
    setOutputKeyClass(Text.class);
    setOutputValueClass(StringIntPairWritable.class);

I am not sure why I decided InputKey to be LongWritable, just went by one
of the examples and this parameter is unused in parseVertex implementation.

Is there something wrong with my definitions ?

StringIntPairWritable is similar to IntIntPairWritable where I wanted the
predecessor to be string type.

My latest error is:
13/08/10 23:23:53 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
java.lang.IllegalArgumentException: Messages must never be behind the
vertex in ID! Current Message ID: five vs. fivehundredeighty
    at org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
    at
org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)


Regards,
Mahesh Babu



On Fri, Aug 9, 2013 at 8:35 PM, Mahesh Babu <jmbabu@gmail.com> wrote:

> Hi,
>
> Can you help me understand:
> 1) How to check input graph type
> 2) How to debug partition jobs
>
> Insights would be helpful.
>
> Regards,
> Mahesh Babu
>
>
> On Fri, Aug 9, 2013 at 5:35 PM, Edward J. Yoon <edwardyoon@apache.org>wrote:
>
>> Hi,
>>
>> Integer ID (1, 2, ..) should be fine. As other people said, I think
>> you need to check the input graph type.
>>
>> On Fri, Aug 9, 2013 at 8:50 PM, Mahesh Babu <jmbabu@gmail.com> wrote:
>> > Hi Edward,
>> >
>> > I replaced node names from 1 to "one", 6288 to
>> > "sixthousandtwohundredeightyeight", etc.
>> > I am not getting the error now. so it may be something to do with number
>> > itself being the name.
>> >
>> > Will monitor if I hit at this error once again. For now it is working.
>> > Proceeding with some more code changes.
>> >
>> > Thanks,
>> > Mahesh Babu
>> >
>> >
>> > On Fri, Aug 9, 2013 at 2:38 PM, Mahesh Babu <jmbabu@gmail.com> wrote:
>> >
>> >> Hi Edward,
>> >>
>> >> In my case vertices are named with numbers. like 1,2,3...etc itself. No
>> >> alphabets in the vertex name, it is just 1 to 10000+ nodes identified
>> by
>> >> the number itself.
>> >>
>> >> You think that could be reason ?
>> >>
>> >> Regards,
>> >> Mahesh Babu
>> >>
>> >>
>> >> On Fri, Aug 9, 2013 at 1:58 PM, Edward J. Yoon <edwardyoon@apache.org
>> >wrote:
>> >>
>> >>> It occurs when the vertices are unsorted.
>> >>>
>> >>> Please check whether your vertex parser reads correctly, and
>> >>> partitioning job was run before the graph job.
>> >>>
>> >>> On Fri, Aug 9, 2013 at 3:43 PM, Mahesh Babu <jmbabu@gmail.com>
wrote:
>> >>> > Hi,
>> >>> >
>> >>> > adding more details about the environment.
>> >>> >
>> >>> > When I run hama-examples-0.6.2.jar with tutorial example/input
>> (berlin
>> >>> > example) file it works without any error.
>> >>> >
>> >>> > Now when I try my own input file which has approximately 10k nodes
>>  and
>> >>> 39k
>> >>> > edges but it fails with:
>> >>> >
>> >>> >        java.lang.IllegalArgumentException: Messages must never
be
>> >>> behind the
>> >>> > vertex in ID! Current Message ID: 2 vs. 20
>> >>> >
>> >>> > What am I doing wrong ?
>> >>> >
>> >>> > Any help/explanation is appreciated.
>> >>> >
>> >>> > Regards,
>> >>> > Mahesh Babu
>> >>> >
>> >>> >
>> >>> >
>> >>> >
>> >>> > On Thu, Aug 8, 2013 at 4:25 PM, Mahesh Babu <jmbabu@gmail.com>
>> wrote:
>> >>> >>
>> >>> >> Hi,
>> >>> >>
>> >>> >> I followed the SSSP example, GraphJob example and getting following
>> >>> error:
>> >>> >>
>> >>> >> 13/08/08 16:01:57 INFO bsp.BSPJobClient: Current supersteps
>> number: 0
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> mortbay.log:
>> >>> >> Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log)
via
>> >>> >> org.mortbay.log.Slf4jLog
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> >>> >> sync.ZKSyncClient: Initializing ZK Sync Client
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> >>> >> sync.ZooKeeperSyncClientImpl: Start connecting to Zookeeper!
At
>> >>> >> localhost/127.0.0.1:61001
>> >>> >>
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
>> >>> >> message.MessageTransferQueueFactory: Message queue is configured
on
>> >>> >> deprecated parameter:hama.messenger.queue.class
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
>> >>> >> message.MessageTransferQueueFactory: Message queue is configured
on
>> >>> >> deprecated parameter:hama.messenger.queue.class
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> ipc.Server:
>> >>> >> Starting SocketReader
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> ipc.Server:
>> >>> IPC
>> >>> >> Server Responder: starting
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> ipc.Server:
>> >>> IPC
>> >>> >> Server listener on 61001: starting
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> >>> >> message.HadoopMessageManagerImpl:  BSPPeer address:localhost
>> port:61001
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> ipc.Server:
>> >>> IPC
>> >>> >> Server handler 0 on 61001: starting
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> >>> >> graph.GraphJobRunner: 4935 vertices are loaded into localhost:61001
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
>> >>> >> message.MessageTransferQueueFactory: Message queue is configured
on
>> >>> >> deprecated parameter:hama.messenger.queue.class
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
>> >>> >> message.MessageTransferQueueFactory: Message queue is configured
on
>> >>> >> deprecated parameter:hama.messenger.queue.class
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
>> >>> >> message.MessageTransferQueueFactory: Message queue is configured
on
>> >>> >> deprecated parameter:hama.messenger.queue.class
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
>> >>> >> message.MessageTransferQueueFactory: Message queue is configured
on
>> >>> >> deprecated parameter:hama.messenger.queue.class
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
>> >>> >> message.MessageTransferQueueFactory: Message queue is configured
on
>> >>> >> deprecated parameter:hama.messenger.queue.class
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 ERROR
>> >>> bsp.BSPTask:
>> >>> >> Error running bsp setup and bsp function.
>> >>> >> attempt_201308081548_0005_000000_0:
>> java.lang.IllegalArgumentException:
>> >>> >> Messages must never be behind the vertex in ID! Current Message
>> ID: 2
>> >>> vs. 20
>> >>> >> attempt_201308081548_0005_000000_0:     at
>> >>> >>
>> org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
>> >>> >> attempt_201308081548_0005_000000_0:     at
>> >>> >>
>> >>>
>> org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)
>> >>> >> attempt_201308081548_0005_000000_0:     at
>> >>> >> org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133)
>> >>> >> attempt_201308081548_0005_000000_0:     at
>> >>> >> org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177)
>> >>> >> attempt_201308081548_0005_000000_0:     at
>> >>> >> org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
>> >>> >> attempt_201308081548_0005_000000_0:     at
>> >>> >>
>> >>>
>> org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262)
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
>> >>> >> message.MessageTransferQueueFactory: Message queue is configured
on
>> >>> >> deprecated parameter:hama.messenger.queue.class
>> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
>> ipc.Server:
>> >>> >> Stopping server on 61001
>> >>> >>
>> >>> >>
>> >>> >> What could be the reason I am getting this error.
>> >>> >>
>> >>> >> I am able to run the code in eclipse/standalong environment.
>> However,
>> >>> when
>> >>> >> I try to run with hama/hadoop pseudo distribution mode it fails.
>> >>> >>
>> >>> >> Thanks,
>> >>> >> Mahesh Babu
>> >>> >>
>> >>> >
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Best Regards, Edward J. Yoon
>> >>> @eddieyoon
>> >>>
>> >>
>> >>
>>
>>
>>
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message