From user-return-33930-archive-asf-public=cust-asf.ponee.io@flink.apache.org Mon Apr 6 20:27:21 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id BA5AE180647 for ; Mon, 6 Apr 2020 22:27:20 +0200 (CEST) Received: (qmail 97750 invoked by uid 500); 6 Apr 2020 20:27:19 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 97735 invoked by uid 99); 6 Apr 2020 20:27:18 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 Apr 2020 20:27:18 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 6EDB5C1E80 for ; Mon, 6 Apr 2020 20:27:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.101 X-Spam-Level: X-Spam-Status: No, score=0.101 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, URI_HEX=0.1] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id wPmih1jrJZ-C for ; Mon, 6 Apr 2020 20:27:16 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.167.182; helo=mail-oi1-f182.google.com; envelope-from=fhueske@gmail.com; receiver= Received: from mail-oi1-f182.google.com (mail-oi1-f182.google.com [209.85.167.182]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 2E5C0BB8A7 for ; Mon, 6 Apr 2020 20:27:16 +0000 (UTC) Received: by mail-oi1-f182.google.com with SMTP id k18so14358316oib.3 for ; Mon, 06 Apr 2020 13:27:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Wvc0N0ZC0eT41+i2UuCNC8Tmuh3V465TdL3q7AumPzU=; b=l58XXpmp7hQdBHwxDpukXOp3DsThy8d3ZSAQQBoOg2ezhpeZ6sjXCfsVsa+4i/i6rL cTRGeujmeb7OfVhbNz6A+7XEaZ9Zc/lkzFKPUEAle9sSXPT8wvvIqnBvpW7jb1En3cgy VjZg18M78w8SbeUnYbvpCMMuAB12Hdv5s/Eoc2sBortTGM0FKjRH1WXGQHK3oqsTO52K CxGvUFWklN+P02c6GsE4Jo2zuiOIx6th9hNSgYTzmIyWHR/bqohGl72KuRj4YV65QYWu wEBQvuMJr6jGSTcscoth7C0ndDsrELoRWV3htogPGFx0Qy/im0DTKyS0MU94neDaMJYR bm4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Wvc0N0ZC0eT41+i2UuCNC8Tmuh3V465TdL3q7AumPzU=; b=jI4Go7xadpxD3bJt/wlPPd+zFbpGb9FGpcyCcMtKyUTar4pA9/6T3YSliw+og5r131 Ex7NAwh6j75V4kkvJ/bXAnDL4Yrv1txkWDJgKZ+HpICAeU34kDg4Ea+8/6izRcGCHmzJ mAWbFDuz0A3EPg5/iv5Uiyl9Da+t5Cc4lFp4Y1wRIxi05x9MCThYljFxGxUOkEjg74GR ZIhQgz65C8ynKWympAy//i1YruHGDv6i9Xsak9owDZoixpBEyRsNg1YtXu8I5x1CgjG2 ub84IB1DR01Tpv0ckwMyt6jppFZbrCqn/buHy5LVEQpnzyhlyWKwe/hvjPFV3040PqTU oL3Q== X-Gm-Message-State: AGi0Puajsu5Cca5KXXlX92zFLFVpVtJhzr+sLYS40KILHeH53jh2HpYK xhDMCYInOC0Z2r0IB6RIlghHQP6WGTYW7LKSCTM= X-Google-Smtp-Source: APiQypIgpW9dRrxXdLtv+cu8N1F2EJULp8i+xW7SQs1qazlK5tsjItcvfbLfOqBejhVdzpBXGJrIkaFpEfEcdCzXdQo= X-Received: by 2002:aca:d489:: with SMTP id l131mr1002889oig.5.1586204829311; Mon, 06 Apr 2020 13:27:09 -0700 (PDT) MIME-Version: 1.0 References: <1586118800658-0.post@n4.nabble.com> In-Reply-To: <1586118800658-0.post@n4.nabble.com> From: Fabian Hueske Date: Mon, 6 Apr 2020 22:26:33 +0200 Message-ID: Subject: Re: Storing Operator state in RocksDb during runtime - plans To: KristoffSC Cc: user Content-Type: multipart/alternative; boundary="0000000000006465f405a2a5175f" --0000000000006465f405a2a5175f Content-Type: text/plain; charset="UTF-8" Hi Kristoff, I'm not aware of any concrete plans for such a feature. Best, Fabian Am So., 5. Apr. 2020 um 22:33 Uhr schrieb KristoffSC < krzysiek.chmielewski@gmail.com>: > Hi, > according to [1] operator state and broadcast state (which is a "special" > type of operator state) are not stored in RocksDb during runtime when > RocksDb is choosed as state backend. > > Are there any plans to change this? > > I'm working around a case where I will have a quite large control stream. > > > [1] > > https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/broadcast_state.html > > > > -- > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ > --0000000000006465f405a2a5175f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Kristoff,

I'm not= aware of any concrete plans for such a feature.

B= est,
Fabian

Am So., 5. Apr. 2020 um 22:33=C2=A0Uhr schri= eb KristoffSC <krzysie= k.chmielewski@gmail.com>:
Hi,
according to [1] operator state and broadcast state (which is a "speci= al"
type of operator state) are not stored in RocksDb during runtime when
RocksDb is choosed as state backend.

Are there any plans to change this?

I'm working around a case where I will have a quite large control strea= m.


[1]
https://= ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/broadcast_s= tate.html



--
Sent from: http://apache-flink-u= ser-mailing-list-archive.2336050.n4.nabble.com/
--0000000000006465f405a2a5175f--