flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sunjincheng (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (FLINK-6204) Update all OVER window ProcessFunction implementations to use the SortedQueueState
Date Thu, 30 Mar 2017 09:46:41 GMT

    [ https://issues.apache.org/jira/browse/FLINK-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948717#comment-15948717
] 

sunjincheng edited comment on FLINK-6204 at 3/30/17 9:46 AM:
-------------------------------------------------------------

Yes, That's My meaning. This JIRA. will do the second task `#2).Update all OVER window ProcessFunction
implementations to use the SortedQueueState` And I'll add a JIRA.[FLINK-6219|https://issues.apache.org/jira/browse/FLINK-6219]
for `#1).Add SortedQueueState, which allows for efficient insertion, traversal in order, and
removal from the head`. 
Best,
SunJincheng


was (Author: sunjincheng121):
Yes, That's My meaning. This JIRA. will do the second task `#2).Update all OVER window ProcessFunction
implementations to use the SortedQueueState` And I'll add a JIRA. for `#1).Add SortedQueueState,
which allows for efficient insertion, traversal in order, and removal from the head`. 
Best,
SunJincheng

>  Update all OVER window ProcessFunction implementations to use the SortedQueueState
> -----------------------------------------------------------------------------------
>
>                 Key: FLINK-6204
>                 URL: https://issues.apache.org/jira/browse/FLINK-6204
>             Project: Flink
>          Issue Type: Bug
>          Components: Table API & SQL
>            Reporter: sunjincheng
>            Assignee: sunjincheng
>
> Currently `event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL`  implementation
 class: ` UnboundedEventTimeOverProcessFunction` use data size uncontrollable memory data
structures`sortedTimestamps: util.LinkedList [Long] cache data timestamps and sort timestamps.
IMO,It's not a good way, because in the production environment there are millions of window
data pre millisecond in our application scenario.So, I want to remove `util.LinkedList [Long]
`. Welcome anyone to give me feedback.
> What do you think? [~fhueske] and [~Yuhong_kyo]
> When a SortedQueueState is available´╝îwe will Update all OVER window ProcessFunction
implementations to use the SortedQueueState.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message