Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2DE8C200B4C for ; Fri, 22 Jul 2016 15:32:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2C98B160A8E; Fri, 22 Jul 2016 13:32:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 76603160A5A for ; Fri, 22 Jul 2016 15:32:21 +0200 (CEST) Received: (qmail 40209 invoked by uid 500); 22 Jul 2016 13:32:20 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 40192 invoked by uid 99); 22 Jul 2016 13:32:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Jul 2016 13:32:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 82F8B2C0059 for ; Fri, 22 Jul 2016 13:32:20 +0000 (UTC) Date: Fri, 22 Jul 2016 13:32:20 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-3779) Add support for queryable state MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 22 Jul 2016 13:32:22 -0000 [ https://issues.apache.org/jira/browse/FLINK-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15389496#comment-15389496 ] ASF GitHub Bot commented on FLINK-3779: --------------------------------------- Github user soumyasd commented on the issue: https://github.com/apache/flink/pull/2051 Any idea which Flink version this feature is going live with ? > Add support for queryable state > ------------------------------- > > Key: FLINK-3779 > URL: https://issues.apache.org/jira/browse/FLINK-3779 > Project: Flink > Issue Type: Improvement > Components: Distributed Coordination > Reporter: Ufuk Celebi > Assignee: Ufuk Celebi > > Flink offers state abstractions for user functions in order to guarantee fault-tolerant processing of streams. Users can work with both non-partitioned (Checkpointed interface) and partitioned state (getRuntimeContext().getState(ValueStateDescriptor) and other variants). > The partitioned state interface provides access to different types of state that are all scoped to the key of the current input element. This type of state can only be used on a KeyedStream, which is created via stream.keyBy(). > Currently, all of this state is internal to Flink and used in order to provide processing guarantees in failure cases (e.g. exactly-once processing). > The goal of Queryable State is to expose this state outside of Flink by supporting queries against the partitioned key value state. > This will help to eliminate the need for distributed operations/transactions with external systems such as key-value stores which are often the bottleneck in practice. Exposing the local state to the outside moves a good part of the database work into the stream processor, allowing both high throughput queries and immediate access to the computed state. > This is the initial design doc for the feature: https://docs.google.com/document/d/1NkQuhIKYmcprIU5Vjp04db1HgmYSsZtCMxgDi_iTN-g. Feel free to comment. -- This message was sent by Atlassian JIRA (v6.3.4#6332)