apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doyle, Austin O." <Austin.O.Doyl...@leidos.com>
Subject RE: Data duplication between operators
Date Tue, 20 Dec 2016 13:13:50 GMT
The downstream operator doesn't seem to be failing and through some local tests I can confirm
that each operator works separately.  Could it be something else?

-Austin

From: Vlad Rozov [mailto:v.rozov@datatorrent.com]
Sent: Monday, December 19, 2016 6:40 PM
To: users@apex.apache.org
Subject: Re: Data duplication between operators

This will be a bug unless the downstream operator constantly fails and is restored to a checkpoint
in which case it is expected that it may get the same tuple multiple times.

Thank you,

Vlad
On 12/19/16 11:33, Doyle, Austin O. wrote:
I'm trying to send some sequential data between an S3 Input Operator and a CSV Parser operator.
 I added logging to see what the outputPort is emitting and it seems to be straightforward
(data points 1 to 1000).  I added logging on the input of the CSV Parser which receives 1000
data points but not the correct data points.  It actually receives random data points multiple
times (like point 57 twenty or so times).  Has anyone seen anything like this?

Thanks,
Austin


Mime
View raw message