kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-3794) Add Stream / Table prefix in print functions
Date Fri, 01 Jul 2016 02:09:10 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358238#comment-15358238

ASF GitHub Bot commented on KAFKA-3794:

GitHub user bbejeck opened a pull request:


    KAFKA-3794: added stream / table names as prefix to functions that pr…

    …int to the console.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/bbejeck/kafka KAFKA-3794-add-prefix-to-print-functions

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1577
commit f5334e134b0d6a743f24dcfd7d1d9cb6d92964c9
Author: bbejeck <bbejeck@gmail.com>
Date:   2016-07-01T02:08:05Z

    KAFKA-3794: added stream / table names as prefix to functions that print to the console.


> Add Stream / Table prefix in print functions
> --------------------------------------------
>                 Key: KAFKA-3794
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3794
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>            Reporter: Guozhang Wang
>            Assignee: Bill Bejeck
>              Labels: newbie, user-experience
> Currently the KTable/KStream.print() operator will print the key-value pair as it was
forwarded to this operator. However, if there are multiple operators in the topologies with
the same {{PrintStream}} (e.g. stdout), their printed key-value pairs will be interleaving
on that stream channel.
> Hence it is better to add a prefix for different KStream/KTable.print operators. One
> 1) For KTable, it inherits a table name when created, and we can use that name as the
prefix as {{[table-name]: key, value}}.
> 2) For KStream, we can overload the function with an additional "name" parameter that
we use as the prefix; if it is not specified, then we can use the parent processor node name,
which has the pattern like {{KSTREAM-JOIN-suffix_index}}.

This message was sent by Atlassian JIRA

View raw message