hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paul Wilkinson <paul.m.wilkin...@gmail.com>
Subject Re: Set<IntWritable> on reducer issue
Date Wed, 08 May 2013 15:29:26 GMT
See
http://cornercases.wordpress.com/2011/08/18/hadoop-object-reuse-pitfall-all-my-reducer-values-are-the-same/for
an explanation of what's going on.

Paul


On 8 May 2013 16:10, Thamizhannal Paramasivam <thamizhannal.p@gmail.com>wrote:

> Hi,
> I require clarification on using IntWritable in Set type in Java.
> Below is my sample code. When I execute reducer with E.x. key="abcd"
> values=12,3,4, then categorySet have any one value from values.
>
> My hadoop version is 0.20.2. Any help would be appreciated.
>
>         public void reduce(Text key, Iterable<IntWritable> values,
>                 Context context) throws IOException, InterruptedException {
>
>              Set<IntWritable> categorySet = new TreeSet<IntWritable>();
>              for (IntWritable val : values) {
>                  categorySet.add(val);
>              }
>             ----------------
>             ----------------
>     }
>
> Thanks,
> Thamizh
>

Mime
View raw message