flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Syinchwun Leo (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-5572) ListState in SlidingEventTimeWindow and SlidingProcessingTimeWindow optimization
Date Thu, 19 Jan 2017 13:19:27 GMT
Syinchwun Leo created FLINK-5572:
------------------------------------

             Summary: ListState in SlidingEventTimeWindow and SlidingProcessingTimeWindow
optimization
                 Key: FLINK-5572
                 URL: https://issues.apache.org/jira/browse/FLINK-5572
             Project: Flink
          Issue Type: Improvement
          Components: Core
    Affects Versions: 1.1.4, 1.2.0
         Environment: CentOS 7.2
            Reporter: Syinchwun Leo


When using ListState in SlidingEventTimeWindow and SlidingProcessingTimeWindow, an element
 may be assigned to multiple overlapped windows. It may lead to storage consuming. for example,

window(SlidingEventTimeWindows.of(Time.seconds(10), Time.seconds(2))).apply(UDF window function),
each element is assigned to 5 windows, shown as the following Fig. When the window size is
very large, it is unacceptable(size/slide is very large).

We plan to make a little optimization, and the doc is in 
https://docs.google.com/document/d/1HCt1Si3YNGFwsl2H5SO0f7WD69DdBBPVJA6abd3oFWo/edit?usp=sharing


Comments?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message