flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor
Date Sat, 04 Jun 2016 09:40:59 GMT
Tzu-Li (Gordon) Tai created FLINK-4020:
------------------------------------------

             Summary: Remove shard list querying from Kinesis consumer constructor
                 Key: FLINK-4020
                 URL: https://issues.apache.org/jira/browse/FLINK-4020
             Project: Flink
          Issue Type: Sub-task
          Components: Streaming Connectors
            Reporter: Tzu-Li (Gordon) Tai


Currently FlinkKinesisConsumer is querying for the whole list of shards in the constructor,
forcing the client to be able to access Kinesis as well. This is also a drawback for handling
Kinesis-side resharding, since we'd want all shard listing / shard-to-task assigning / shard
end (result of resharding) handling logic to be capable of being independently done within
task life cycle methods, with defined and definite results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message