flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jiayi Liao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-10807) KafkaConsumer still consume removed topic after changing topics list
Date Wed, 07 Nov 2018 07:21:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jiayi Liao updated FLINK-10807:
-------------------------------
    Description: subscribedPartitionsToStartOffsets in KafkaConsumerBase is getting values
from restoredState, which is initialized in initializeState and discovering partitions. However,
if we remove a topic in topics list and restore the Flink program, the restoredState still
keeps removed topic, and the fetcher still fetches the data of the removed topic.  (was: subscribedPartitionsToStartOffsets
in KafkaConsumerBase is getting values from restoredState, which is initialized in initializeState
and discovering partitions. However, if we remove a topic in topics list and restore the Flink
program, the restoredState still keeps removed topic, and the fetcher will still fetch the
data of the topic.)

> KafkaConsumer still consume removed topic after changing topics list
> --------------------------------------------------------------------
>
>                 Key: FLINK-10807
>                 URL: https://issues.apache.org/jira/browse/FLINK-10807
>             Project: Flink
>          Issue Type: Bug
>          Components: Kafka Connector
>    Affects Versions: 1.6.2
>            Reporter: Jiayi Liao
>            Assignee: Jiayi Liao
>            Priority: Major
>
> subscribedPartitionsToStartOffsets in KafkaConsumerBase is getting values from restoredState,
which is initialized in initializeState and discovering partitions. However, if we remove
a topic in topics list and restore the Flink program, the restoredState still keeps removed
topic, and the fetcher still fetches the data of the removed topic.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message