kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nikki Thean (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-3455) Connect custom processors with the streams DSL
Date Tue, 04 Apr 2017 19:19:41 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955651#comment-15955651

Nikki Thean commented on KAFKA-3455:

If it helps, as a user, I have done exactly this and found it pretty intuitive. My app was
built last December.

> Connect custom processors with the streams DSL
> ----------------------------------------------
>                 Key: KAFKA-3455
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3455
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: streams
>    Affects Versions:
>            Reporter: Jonathan Bender
>              Labels: user-experience
>             Fix For:
> From the kafka users email thread, we discussed the idea of connecting custom processors
with topologies defined from the Streams DSL (and being able to sink data from the processor).
 Possibly this could involve exposing the underlying processor's name in the streams DSL so
it can be connected with the standard processor API.
> {quote}
> Thanks for the feedback. This is definitely something we wanted to support
> in the Streams DSL.
> One tricky thing, though, is that some operations do not translate to a
> single processor, but a sub-graph of processors (think of a stream-stream
> join, which is translated to actually 5 processors for windowing / state
> queries / merging, each with a different internal name). So how to define
> the API to return the processor name needs some more thinking.
> {quote}

This message was sent by Atlassian JIRA

View raw message