flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elias Levy (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3946) State API Should Support Data Expiration
Date Fri, 20 May 2016 20:44:12 GMT
Elias Levy created FLINK-3946:

             Summary: State API Should Support Data Expiration
                 Key: FLINK-3946
                 URL: https://issues.apache.org/jira/browse/FLINK-3946
             Project: Flink
          Issue Type: Improvement
          Components: state backends
    Affects Versions: 1.0.3
            Reporter: Elias Levy

The state API should support data expiration.  Consider a custom data stream operator that
operates on a keyed stream and maintains a cache of items in its keyed state.  The operator
can expire items in the state based on event time or  processing time.  But as the state is
keyed, if the operator is never invoked again for a previously observed key, the state associated
with that key will never be expired, leading the overall job state to grow indefinitely.

This message was sent by Atlassian JIRA

View raw message