flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gyula Fora (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-2324) Rework partitioned state storage
Date Tue, 07 Jul 2015 08:34:04 GMT
Gyula Fora created FLINK-2324:
---------------------------------

             Summary: Rework partitioned state storage
                 Key: FLINK-2324
                 URL: https://issues.apache.org/jira/browse/FLINK-2324
             Project: Flink
          Issue Type: Improvement
            Reporter: Gyula Fora
            Assignee: Gyula Fora


Partitioned states are currently stored per-key in statehandles. This is alright for in-memory
storage but is very inefficient for HDFS. 

The logic behind the current mechanism is that this approach provides a way to repartition
a state without fetching the data from the external storage and only manipulating handles.

We should come up with a solution that can achieve both.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message