Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@kafka.apache.org
Date: Tue, 13 Dec 2016 18:13:58 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: dev@kafka.apache.org
Message-ID: <JIRA.13027815.1481643694000.510961.1481652838757@Atlassian.JIRA>
In-Reply-To: <JIRA.13027815.1481643694000@Atlassian.JIRA>
References: <JIRA.13027815.1481643694000@Atlassian.JIRA> <JIRA.13027815.1481643694168@arcas>
Subject: [jira] [Commented] (KAFKA-4532) StateStores can be connected to the
 wrong source topic resulting in incorrect metadata returned from IQ
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 13 Dec 2016 18:14:01 -0000


    [ https://issues.apache.org/jira/browse/KAFKA-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15745809#comment-15745809 ] 

ASF GitHub Bot commented on KAFKA-4532:
---------------------------------------

GitHub user dguy opened a pull request:

    https://github.com/apache/kafka/pull/2250

    KAFKA-4532: StateStores can be connected to the wrong source topic resulting in incorrect metadata returned from Interactive Queries

    When building a topology with tables and StateStores, the StateStores are mapped to the source topic names. This map is retrieved via TopologyBuilder.stateStoreNameToSourceTopics() and is used in Interactive Queries to find the source topics and partitions when resolving the partitions that particular keys will be in.
    There is an issue where by this mapping for a table that is originally created with builder.table("topic", "table");, and then is subsequently used in a join, is changed to the join topic. This is because the mapping is updated during the call to topology.connectProcessorAndStateStores(..).
    In the case that the stateStoreNameToSourceTopics Map already has a value for the state store name it should not update the Map.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/dguy/kafka kafka-4532

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/kafka/pull/2250.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2250
    
----
commit 45833be3ca1b6f8ac86f516cae4ff1b6571089e8
Author: Damian Guy <damian.guy@gmail.com>
Date:   2016-12-13T18:06:38Z

    state store name to topic mapping incorrect

----


> StateStores can be connected to the wrong source topic resulting in incorrect metadata returned from IQ
> -------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-4532
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4532
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 0.10.1.0, 0.10.1.1, 0.10.2.0
>            Reporter: Damian Guy
>            Assignee: Damian Guy
>             Fix For: 0.10.2.0
>
>
> When building a topology with tables and StateStores, the StateStores are mapped to the source topic names. This map is retrieved via {{TopologyBuilder.stateStoreNameToSourceTopics()}} and is used in Interactive Queries to find the source topics and partitions when resolving the partitions that particular keys will be in.
> There is an issue where by this mapping for a table that is originally created with {{builder.table("topic", "table");}}, and then is subsequently used in a join, is changed to the join topic. This is because the mapping is updated during the call to {{topology.connectProcessorAndStateStores(..)}}. 
> In the case that the {{stateStoreNameToSourceTopics}} Map already has a value for the state store name it should not update the Map.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)