flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sunjincheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-6204) Improve Event-Time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL
Date Thu, 30 Mar 2017 09:10:41 GMT

    [ https://issues.apache.org/jira/browse/FLINK-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948717#comment-15948717
] 

sunjincheng commented on FLINK-6204:
------------------------------------

Yes, That's My meaning. This JIRA. will do the second task[#2).Update all OVER window ProcessFunction
implementations to use the SortedQueueState] And I'll add a JIRA. for [#1).Add SortedQueueState,
which allows for efficient insertion, traversal in order, and removal from the head]. 
Best,
SunJincheng

> Improve Event-Time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL
> ---------------------------------------------------------------------------
>
>                 Key: FLINK-6204
>                 URL: https://issues.apache.org/jira/browse/FLINK-6204
>             Project: Flink
>          Issue Type: Bug
>          Components: Table API & SQL
>            Reporter: sunjincheng
>            Assignee: sunjincheng
>
> Currently `event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL`  implementation
 class: ` UnboundedEventTimeOverProcessFunction` use data size uncontrollable memory data
structures`sortedTimestamps: util.LinkedList [Long] cache data timestamps and sort timestamps.
IMO,It's not a good way, because in the production environment there are millions of window
data pre millisecond in our application scenario.So, I want to remove `util.LinkedList [Long]
`. Welcome anyone to give me feedback.
> What do you think? [~fhueske] and [~Yuhong_kyo]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message