apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gaurav Gupta <gau...@datatorrent.com>
Subject Re: Is there a way of defining a default partitioner for an operator besides implement partitioner interface
Date Fri, 20 Nov 2015 04:54:14 GMT
I also think property works better because as Thomas mentioned it can be configured like any
other operator component.

Thanks
- Gaurav

> On Nov 19, 2015, at 5:24 PM, Isha Arkatkar <isha@datatorrent.com> wrote:
> 
> I also think property works better, though, can be an easier API to 'set
> number of partitions for operator to N' And internally it can pick up
> Stateless Partitioner as default?
> 
> Thanks,
> Isha
> 
> 
> On Thu, Nov 19, 2015 at 5:15 PM, Thomas Weise <thomas@datatorrent.com>
> wrote:
> 
>> I actually think a property works better as it will let you configure the
>> partitioner like any other operator component. Like the Kafka consumer.
>> 
>> --
>> sent from mobile
>> On Nov 19, 2015 4:51 PM, "Siyuan Hua" <siyuan@datatorrent.com> wrote:
>> 
>>> Thomas, this is what I'm going to do. But I like Pramod's idea to have an
>>> annotation
>>> 
>>> On Thu, Nov 19, 2015 at 4:34 PM, Thomas Weise <thomas@datatorrent.com>
>>> wrote:
>>> 
>>>> Why not implement the interface on the operator and delegate the call
>> to
>>>> the partitioner implementation?
>>>> 
>>>> On Thu, Nov 19, 2015 at 4:09 PM, Pramod Immaneni <
>> pramod@datatorrent.com
>>>> 
>>>> wrote:
>>>> 
>>>>> Idea for an annotation maybe?
>>>>> 
>>>>> On Thu, Nov 19, 2015 at 3:49 PM, Siyuan Hua <siyuan@datatorrent.com>
>>>>> wrote:
>>>>> 
>>>>>> Sometimes I want to separate the Partitioner logic from operator
>> and
>>>>> still
>>>>>> I want to have default partitioner for the operator (with
>> specifying
>>> it
>>>>>> from application)
>>>>>> 
>>>>>> 
>>>>>> Best,
>>>>>> Siyuan
>>>>>> 
>>>>> 
>>>> 
>>> 
>> 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message