apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandesh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2521) Expose kafka's committed offset and latest offset in Kafka input operator
Date Tue, 18 Jul 2017 00:58:00 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16090913#comment-16090913
] 

Sandesh commented on APEXMALHAR-2521:
-------------------------------------

[~ramapv]

Committed offset can be accessed by overriding the following method, onComplete(Map<TopicPartition,
OffsetAndMetadata> map, Exception e), in the operator that extends the AbstractkafkaInputOperator

Please let me know whether that works for you.

> Expose kafka's committed offset and latest offset in Kafka input operator
> -------------------------------------------------------------------------
>
>                 Key: APEXMALHAR-2521
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2521
>             Project: Apache Apex Malhar
>          Issue Type: New Feature
>            Reporter: Venkata Rama Puppala
>            Assignee: Sandesh
>
> Can we expose the current committed offset and the latest offset (for the kafka partitions
an operator partition is processing) to an operator that extends the kafka input operator.
These can be used to determine the lag.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message