giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fredrik Einarsson <einarsso...@gmail.com>
Subject Re: Error in executing shortest path problem while working with own input data
Date Thu, 29 Jan 2015 19:27:02 GMT
Thanks so much for your answer. However it didn't solve it. I think I had
some problem related to hadoop giraph versions. I downloaded precompiled
packages and now it is working :)

*Kind regards*
Fredrik Einarsson

2015-01-29 11:50 GMT+01:00 Phalguni Mukherjee <
phalgunimukherjee1007@gmail.com>:

> I have written my own JSON data format as
>
>
> [{"id":0,"name":"father","value":0},[{"id":1,"name":"father","value":1},{"id":3,"name":"mother","value":3}]]
>
> [{"id":1,"name":"father","value":0},[{"id":0,"name":"father","value":1},{"id":2,"name":"mother","value":2},{"id":4,"name":"mother","value":4}]]
>
> [{"id":2,"name":"father","value":0},[{"id":1,"name":"father","value":2},{"id":4,"name":"mother","value":4}]]
>
> But when I run the code I get error as:
>
> "org.apache.hadoop.mapred.Counters$CountersExceededException: Error:
> Exceeded limits on number of counters - Counters=120 Limit=120
> at
>
> org.apache.hadoop.mapred.Counters$Group.getCounterForName(Counters.java:319)
> at org.apache.hadoop.mapred.Counters.findCounter(Counters.java:446)
> at org.apache.hadoop.mapred.Task$TaskReporter.getCounter(Task.java:601)
> at org.apache.hadoop.mapred.Task$TaskReporter.getCounter(Task.java:541)
> at
>
> org.apache.hadoop.mapreduce.TaskInputOutputContext.getCounter(TaskInputOutputContext.java:88)
> at
>
> org.apache.giraph.counters.HadoopCountersBase.getCounter(HadoopCountersBase.java:60)
> at
>
> org.apache.giraph.counters.GiraphTimers.getSuperstepMs(GiraphTimers.java:125)
> at org.apache.giraph.master.MasterThread.run(MasterThread.java:140)"
>
> The same algorithm runs fine with default input format i.e
>
> [0,0,[[1,1],[3,3]]]
> [1,0,[[0,1],[2,2],[3,1]]]
> [2,0,[[1,2],[4,4]]]
> [3,0,[[0,3],[1,1],[4,4]]]
> [4,0,[[3,4],[2,4]]]
>
>
> and get output as:
>
> 0 1.0
>
> 2 2.0
>
> 1 0.0
>
> 3 1.0
>
> 4 5.0
>
>
> I have checked in my input format and algorithm code in the git hub
> location:
>
>
> https://github.com/phalguni1007/PhalguniGiraphLearn
>
>
> Please help
>
> --
> *Thanks & Regards*
> *Phalguni Mukherjee*
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message