flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3274) Prefix Kafka connector accumulators with unique id
Date Fri, 22 Jan 2016 10:05:39 GMT
Robert Metzger created FLINK-3274:

             Summary: Prefix Kafka connector accumulators with unique id
                 Key: FLINK-3274
                 URL: https://issues.apache.org/jira/browse/FLINK-3274
             Project: Flink
          Issue Type: Bug
          Components: Kafka Connector
    Affects Versions: 1.0.0
            Reporter: Robert Metzger
            Assignee: Robert Metzger

Flink might chain together two data sinks under certain conditions.
In that case, the metrics accumulators will have a name clash (each task can have an accumulator
only once, with chaining multiple sinks are sharing a task).

Also, when merging accumulators from different tasks for a per-job result, having multiple
kafka producers or consumers will lead to wrong results as the merging happens only on a per-name

With this issue, I'd like to introduce a unique id for consumers and producers when registering

This message was sent by Atlassian JIRA

View raw message