flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sunjincheng (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-6204) Update all OVER window ProcessFunction implementations to use the SortedQueueState
Date Thu, 30 Mar 2017 09:15:42 GMT

     [ https://issues.apache.org/jira/browse/FLINK-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

sunjincheng updated FLINK-6204:
-------------------------------
    Description: 
Currently `event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL`  implementation
 class: ` UnboundedEventTimeOverProcessFunction` use data size uncontrollable memory data
structures`sortedTimestamps: util.LinkedList [Long] cache data timestamps and sort timestamps.
IMO,It's not a good way, because in the production environment there are millions of window
data pre millisecond in our application scenario.So, I want to remove `util.LinkedList [Long]
`. Welcome anyone to give me feedback.
What do you think? [~fhueske] and [~Yuhong_kyo]

When a SortedQueueState is available,we will Update all OVER window ProcessFunction implementations
to use the SortedQueueState.

  was:
Currently `event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL`  implementation
 class: ` UnboundedEventTimeOverProcessFunction` use data size uncontrollable memory data
structures`sortedTimestamps: util.LinkedList [Long] cache data timestamps and sort timestamps.
IMO,It's not a good way, because in the production environment there are millions of window
data pre millisecond in our application scenario.So, I want to remove `util.LinkedList [Long]
`. Welcome anyone to give me feedback.
What do you think? [~fhueske] and [~Yuhong_kyo]


>  Update all OVER window ProcessFunction implementations to use the SortedQueueState
> -----------------------------------------------------------------------------------
>
>                 Key: FLINK-6204
>                 URL: https://issues.apache.org/jira/browse/FLINK-6204
>             Project: Flink
>          Issue Type: Bug
>          Components: Table API & SQL
>            Reporter: sunjincheng
>            Assignee: sunjincheng
>
> Currently `event time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL`  implementation
 class: ` UnboundedEventTimeOverProcessFunction` use data size uncontrollable memory data
structures`sortedTimestamps: util.LinkedList [Long] cache data timestamps and sort timestamps.
IMO,It's not a good way, because in the production environment there are millions of window
data pre millisecond in our application scenario.So, I want to remove `util.LinkedList [Long]
`. Welcome anyone to give me feedback.
> What do you think? [~fhueske] and [~Yuhong_kyo]
> When a SortedQueueState is available,we will Update all OVER window ProcessFunction
implementations to use the SortedQueueState.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message