kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Schofield <andrew_schofi...@live.com>
Subject Re: [VOTE] KIP-419: Safely notify Kafka Connect SourceTask is stopped
Date Mon, 05 Aug 2019 13:42:01 GMT
I'd like to have a final try at getting some voting on this KIP. I'd like to get it into Kafka
2.4 so get your votes in please.

Currently only +2 non-binding votes.
KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-419%3A+Safely+notify+Kafka+Connect+SourceTask+is+stopped
PR: https://github.com/apache/kafka/pull/6551

The idea is that source connectors are multi-threaded and the signal to stop a running connector
can be delivered while messages are being requested from the source system. It's not rocket
science to handle clean up correctly in a connector, but you might need to create a thread
to wait for activity to quieten down so you can do it safely. This KIP just gives a way to
be called by the KC framework when the connector has properly quiesced. Makes the connector
code a bit simpler, and that's particularly helpful for someone just knocking up a simple
connector without worrying about thread management.

Andrew Schofield

On 25/04/2019, 16:11, "Andrew Schofield" <andrew_schofield@live.com> wrote:

    I'd like to encourage some more votes on KIP-419. It's a pretty small KIP to make it easier
to handle resource clean up in Kafka Connect SourceTasks.
    Currently only +2 non-binding.
    KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-419%3A+Safely+notify+Kafka+Connect+SourceTask+is+stopped
    PR: https://github.com/apache/kafka/pull/6551
    Andrew Schofield
    IBM Event Streams
    On 15/04/2019, 15:59, "Edoardo Comar" <ECOMAR@uk.ibm.com> wrote:
        Thanks Andrew.
        +1 (non-binding)
        Edoardo Comar
        IBM Event Streams
        IBM UK Ltd, Hursley Park, SO21 2JN
        From:   Mickael Maison <mickael.maison@gmail.com>
        To:     dev <dev@kafka.apache.org>
        Date:   10/04/2019 10:14
        Subject:        Re: [VOTE] KIP-419: Safely notify Kafka Connect SourceTask 
        is stopped
        +1 (non-binding)
        Thanks for the KIP!
        On Mon, Apr 8, 2019 at 8:07 PM Andrew Schofield
        <andrew_schofield@live.com> wrote:
        > Hi,
        > I’d like to begin the voting thread for KIP-419. This is a minor KIP to 
        add a new stopped() method to the SourceTask interface in Kafka Connect. 
        Its purpose is to give the task a safe opportunity to clean up its 
        resources, in the knowledge that this is the final call to the task.
        > KIP: 
        > PR: 
        > JIRA: 
        > Thanks,
        > Andrew Schofield
        > IBM
        Unless stated otherwise above:
        IBM United Kingdom Limited - Registered in England and Wales with number 
        Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

View raw message