flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rico Bergmann <i...@ricobergmann.de>
Subject Re: Problem with Windowing
Date Mon, 31 Aug 2015 16:03:29 GMT
The part is exactly as I wrote. ds is assigned a data flow that computes some stuff. Then the
de duplication code as written in my first mail us assigned to a new variable called output.
Then output.addSink(.) is called. 


> Am 31.08.2015 um 17:45 schrieb Matthias J. Sax <mjsax@informatik.hu-berlin.de>:
> 
> Can you post your whole program (both versions if possible)?
> 
> Otherwise I have only a wild guess: A common mistake is not to assign
> the stream variable properly:
> 
> DataStream ds = ...
> 
> ds = ds.APPLY_FUNCTIONS
> 
> ds.APPLY_MORE_FUNCTIONS
> 
> In your code example, the assignment is missing -- but maybe it just
> missing in your email.
> 
> -Matthias
> 
> 
>> On 08/31/2015 04:38 PM, Dipl.-Inf. Rico Bergmann wrote:
>> Hi!
>> 
>> I have a problem that I cannot really track down. I'll try to describe
>> the issue.
>> 
>> My streaming flink program computes something. At the end I'm doing the
>> follwing on my DataStream ds
>> ds.window(2, TimeUnit.SECONDS)
>> .groupBy(/*custom KeySelector converting input to a String
>> representation*/)
>> .mapWindow(/*TypeConversion*/)
>> .flatten()
>> 
>> Then the result is written to a Kafka topic.
>> 
>> The purpose of this is output deduplication within a 2 seconds window...
>> 
>> Without the above the program works fine. But with the above I don't get
>> any output and no error appears in the log. The program keeps running.
>> Am I doing something wrong?
>> 
>> I would be happy for help!
>> 
>> Cheers, Rico.
> 

Mime
View raw message