flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michele Bertoni <michele1.bert...@mail.polimi.it>
Subject inconsistency in count and print
Date Sat, 16 May 2015 07:15:26 GMT
it is 2 days i am going mad with a problem, every time i run the code (on the same dataset)
i get a different result

while i was trying debugging i found this

i have this code

val aggregationResult  = //something that creates the dataset and uses join, group, reduce
and map
logger.error("res count " + aggregationResult.count)

the logger prints a dataset size of 7
the output result is made of 6 elements

this happens randomly sometimes the result is larger than the count and sometimes they are
both correct at 10

flink version 0.9milestone1

any idea of what can make it “not deterministic”?
thanks for help
View raw message