flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Punit Naik <naik.puni...@gmail.com>
Subject Re: Count on grouped keys
Date Fri, 29 Apr 2016 11:49:17 GMT
Yeah no problem. Its not an optimised solution but I think it gives enough
understanding of how reduceGroup works.
On 29-Apr-2016 5:17 PM, "Stefano Baghino" <stefano.baghino@radicalbit.io>
wrote:

> Thanks for sharing the solution, Punit.
>
> On Fri, Apr 29, 2016 at 1:40 PM, Punit Naik <naik.punit44@gmail.com>
> wrote:
>
>> Anyways, I managed to do it. you should attach the following code block
>> to your groupBy
>> .reduceGroup {
>>       (in, out: org.apache.flink.util.Collector[(Map[String,String],
>> Int)]) => // Map[String,String] is the data type I want to output along
>> with the count as Int in a Tuple
>>         var v:Int = 0;
>>         var k:Map[String,String]=Map()
>>         for (t <- in) {
>>           v+=1;
>>           k=t
>>         }
>>         out.collect((k,v))
>>
>> On Fri, Apr 29, 2016 at 3:59 PM, Punit Naik <naik.punit44@gmail.com>
>> wrote:
>>
>>> I have a dataset which has maps. I have performed a groupBy on a key and
>>> I want to count all the elements in a particular group. How do I do this?
>>>
>>> --
>>> Thank You
>>>
>>> Regards
>>>
>>> Punit Naik
>>>
>>
>>
>>
>> --
>> Thank You
>>
>> Regards
>>
>> Punit Naik
>>
>
>
>
> --
> BR,
> Stefano Baghino
>
> Software Engineer @ Radicalbit
>

Mime
View raw message