kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Damian Guy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-3912) Query local state stores
Date Tue, 28 Jun 2016 09:02:57 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Damian Guy updated KAFKA-3912:
------------------------------
    Description: 
Implement read-only interface and QueryableStoreType for key-value state store

Implement read-only interface and QueryableStoreType for windowed state store

Ensure store operations are thread-safe. I.e., a single state store could have concurrent
access, e.g. one stream worker thread updating the store, and one user thread querying the
store.

Ensure failure and rebalancing is handled correctly. I.e., because the "read-only" state store
interface could wrap multiple state stores, since one instance could contain multiple tasks
and hence multiple state stores with the same names. Rebalance could happen migrating state
stores in / out while the user is interacting with the interface.

Add the following method to KafkaStreams
{code} 
public <T> T getStore(final String storeName,final QueryableStoreType<T> queryableStoreType)
{code}

  was:
Implement read-only interface and QueryableStoreType for key-value state store
Implement read-only interface and QueryableStoreType for windowed state store
Ensure store operations are thread-safe. I.e., a single state store could have concurrent
access, e.g. one stream worker thread updating the store, and one user thread querying the
store.
Ensure failure and rebalancing is handled correctly. I.e., because the "read-only" state store
interface could wrap multiple state stores, since one instance could contain multiple tasks
and hence multiple state stores with the same names. Rebalance could happen migrating state
stores in / out while the user is interacting with the interface.
Add the following method to {code} KafkaStreams {code}
{code} 
public <T> T getStore(final String storeName,final QueryableStoreType<T> queryableStoreType)
{code}


> Query local state stores
> ------------------------
>
>                 Key: KAFKA-3912
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3912
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: streams
>    Affects Versions: 0.10.1.0
>            Reporter: Damian Guy
>            Assignee: Damian Guy
>             Fix For: 0.10.1.0
>
>
> Implement read-only interface and QueryableStoreType for key-value state store
> Implement read-only interface and QueryableStoreType for windowed state store
> Ensure store operations are thread-safe. I.e., a single state store could have concurrent
access, e.g. one stream worker thread updating the store, and one user thread querying the
store.
> Ensure failure and rebalancing is handled correctly. I.e., because the "read-only" state
store interface could wrap multiple state stores, since one instance could contain multiple
tasks and hence multiple state stores with the same names. Rebalance could happen migrating
state stores in / out while the user is interacting with the interface.
> Add the following method to KafkaStreams
> {code} 
> public <T> T getStore(final String storeName,final QueryableStoreType<T>
queryableStoreType)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message