apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hitesh Kapoor <hit...@datatorrent.com>
Subject (APEXMALHAR-2291) Exactly-once processing not working correctly for JdbcPOJOInsertOutputOperator
Date Fri, 14 Oct 2016 14:57:31 GMT
Hi All,

It is observed that the exactly-once processing is not working correctly.
The reason for this is that when the operator crashes, it comes back and
inserts data again for non-checkpointed windows.
Hence redundant rows are added in the table. The fix is simple and
suggested by Sandeep is to add a check in endWindow() not to update the
meta data in output store.
I will do the required code change add a corresponding unit test case and
open PR (if there are no objections).

Regards,
Hitesh

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message