apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Priyanka Gugale <priya...@datatorrent.com>
Subject Re: Writing to external systems in reconciled fashion
Date Tue, 04 Oct 2016 10:18:55 GMT
I am specifically looking into HFiles when I mentioned Hbase.

-Priyanka

On Tue, Oct 4, 2016 at 3:47 PM, Priyanka Gugale <priyanka@datatorrent.com>
wrote:

> I am reconsidering using WindowDataManager or Hbase instead of
> ManagedState to implement SpillableQueue.
> Let me know if anyone have any thoughts on same.
>
> -Priyanka
>
> On Thu, Sep 29, 2016 at 5:54 PM, Priyanka Gugale <priyanka@datatorrent.com
> > wrote:
>
>> Hi,
>>
>> Please refer to this link for earlier discussion reference:
>> https://lists.apache.org/list.html?dev@apex.apache.org
>>
>> -Priyanka
>>
>> On Thu, Sep 29, 2016 at 5:46 PM, Priyanka Gugale <
>> priyanka@datatorrent.com> wrote:
>>
>>> Dear community,
>>>
>>> We had a discussion
>>> <https://mail.google.com/mail/u/0/#search/label%3ADiscussion-Forum+reconcile/153bfa055614fd8d?compose=15775dd6fda3cc52>
>>> before about having reconciler for writing to JDBC output operator. I am
>>> proposing to write  a reconciler plugin which should be generic enough to
>>> work with most of output Systems. Please refer this
>>> <https://docs.google.com/document/d/1zKjpBG1nTZ1f3_SjFLVSf5_9Ly9Xl0kzhD5QN6-ZqS0/edit?usp=sharing>
>>> document for design details. We also have a jira
>>> <https://issues.apache.org/jira/browse/APEXMALHAR-2037> for same.
>>>
>>> Please provide your feedback.
>>>
>>> -Priyanka
>>>
>>>
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message