apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vlad Rozov <v.ro...@datatorrent.com>
Subject Re: Data duplication between operators
Date Mon, 19 Dec 2016 23:40:08 GMT
This will be a bug unless the downstream operator constantly fails and 
is restored to a checkpoint in which case it is expected that it may get 
the same tuple multiple times.

Thank you,


On 12/19/16 11:33, Doyle, Austin O. wrote:
> I’m trying to send some sequential data between an S3 Input Operator 
> and a CSV Parser operator.  I added logging to see what the outputPort 
> is emitting and it seems to be straightforward (data points 1 to 
> 1000).  I added logging on the input of the CSV Parser which receives 
> 1000 data points but not the correct data points.  It actually 
> receives random data points multiple times (like point 57 twenty or so 
> times).  Has anyone seen anything like this?
> Thanks,
> Austin

View raw message