kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-4461) When using ProcessorTopologyTestDriver, the combination of map and .groupByKey does not produce any result
Date Thu, 23 Feb 2017 11:37:44 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15880293#comment-15880293
] 

ASF GitHub Bot commented on KAFKA-4461:
---------------------------------------

GitHub user hrafzali opened a pull request:

    https://github.com/apache/kafka/pull/2587

    KAFKA-4461: Added support to ProcessorTopologyTestDriver to forward timestamps to internal
topics

    This resolves the issue in the ProcessorTopologyTestDriver that the extracted timestamp
is not forwarded with the produced record to the internal topics.
    
    JIRA ticket: https://issues.apache.org/jira/browse/KAFKA-4789
    
    The contribution is my original work and I license the work to the project under the project's
open source license.
    
    @guozhangwang @dguy


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/hrafzali/kafka KAFKA-4789_ProcessorTopologyTestDriver_timestamp

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/kafka/pull/2587.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2587
    
----
commit ad6db45916f28971470c0522584c2dca02ffae76
Author: Hamidreza Afzali <hamidreza.afzali@hivestreaming.com>
Date:   2017-02-23T10:53:18Z

    KAFKA-4461: Added support to ProcessorTopologyTestDriver to forward extracted timestamps
to internal topics.

----


> When using ProcessorTopologyTestDriver, the combination of map and .groupByKey does not
produce any result
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-4461
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4461
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 0.10.1.0
>            Reporter: Hamidreza Afzali
>            Assignee: Adrian McCague
>              Labels: newbie, unit-test
>             Fix For: 0.10.3.0
>
>
> *Problem*
> When using ProcessorTopologyTestDriver in the latest Kafka 0.10.1, the combination of
map and .groupByKey does not produce any result. However, it works fine when using KStreamTestDriver.
> The topology looks like this:
> {code}
> builder.stream(Serdes.String, Serdes.Integer, inputTopic)
>  .map((k, v) => new KeyValue(fn(k), v))
>  .groupByKey(Serdes.String, Serdes.Integer)
>  .count(stateStore)
> {code}
> *Full examples*
> Examples for ProcessorTopologyTestDriver and KStreamTestDriver:
> https://gist.github.com/hrafzali/c2f50e7b957030dab13693eec1e49c13
> *Additional info*
> kafka-users mailing list:
> http://mail-archives.apache.org/mod_mbox/kafka-users/201611.mbox/%3CCAHwHRrVq1APVkNhP3HVqxujxRJEP9FwHV2NRcvPPsHX7Wujzng%40mail.gmail.com%3E



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message