From user-return-32062-archive-asf-public=cust-asf.ponee.io@flink.apache.org Fri Jan 17 19:45:48 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id A00CA180636 for ; Fri, 17 Jan 2020 20:45:48 +0100 (CET) Received: (qmail 37705 invoked by uid 500); 17 Jan 2020 19:45:46 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 37686 invoked by uid 99); 17 Jan 2020 19:45:46 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Jan 2020 19:45:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 8BE2418066A; Fri, 17 Jan 2020 19:45:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id EJNQZc_JfCNL; Fri, 17 Jan 2020 19:45:39 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::d2d; helo=mail-io1-xd2d.google.com; envelope-from=elkhan.dadashov@gmail.com; receiver= Received: from mail-io1-xd2d.google.com (mail-io1-xd2d.google.com [IPv6:2607:f8b0:4864:20::d2d]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 8596C7DDE8; Fri, 17 Jan 2020 19:45:38 +0000 (UTC) Received: by mail-io1-xd2d.google.com with SMTP id z8so27284650ioh.0; Fri, 17 Jan 2020 11:45:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=QQAAlzq4bEaNS+85LEaFeR1017nRNx2Sf2cwkzlFhgU=; b=VDlZYH6HMZsFTnD4LS59L/JU3lzkBJKtMc6mzmoxhiNo27qgz4MNI4A5CI2pychZ/B MPAGWeBmi6g5/zseUeLfd46D+f4r9RRE0RR+B/XC18mf/Mt6KvpsrUXeTNirBTmKcm9B kxPL2e+n9HBM9Ao+eKMAEvXGSF5hVi5cHTQxV9QtwLdjKHdd1HZThkEm8eNXMTwlM1KU GPYERKzIHZEDdCex45SUYvwp7p4Kve7cEjozFGsN3oWQt8BwypxMlQljqo0fMC+J/1Mk TBm1OkTdBtviuN98ak2oj3abXlWJTXC+kjB4ZA4zqBfCm41UWvXw/JK3FCrGTrei54Ld eu1Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=QQAAlzq4bEaNS+85LEaFeR1017nRNx2Sf2cwkzlFhgU=; b=lQTH5pKA1bZ9NL/KJKHDXpYgG+NNJ0qi84hG6SVEFLrZgpPl5u/E9w7JkWzqTmYAH5 llui62ZqRukyK20piRaHo2eDVLgAujq2EP4cJ1S1sWWEaQCgC4qHhIsbyjSiwReF9bP0 dS+zl7j1LLesv8x0JqnGu6fcx0DmFlgfiILutn7xWEzuPDZUKtLD8W3F7muTri8J/Rf0 F9bSv1uPDbY7rPdBKtl6jd2+kee1SKQWW5mW0g8x2Svak7CSWVVp44EM9nxTFY9hnWlY HtFfalCCzcXXxRWvu45miX8z/gM20QdKR3AcOMIvOrGPM04Ezo5hus/V0Phd46EL7H+t 04Gw== X-Gm-Message-State: APjAAAWaS+GfW+7tPuRrP/P9GuTtASTCENSs/9XjzN9Ne82bKYpoDL5z Xn5NWokZrTa80ZCZfMfQHBM2DdTMw9G1EAkjTrGtUZa015o= X-Google-Smtp-Source: APXvYqxtar6vESk/flGSEAhc7ENWNs71iPpw4/96Li5obXogs8bWPl6NA1oDSkyw56FJXDyWY/HUJf9Cy7V0/4JkLZQ= X-Received: by 2002:a02:13ca:: with SMTP id 193mr35424440jaz.54.1579290337046; Fri, 17 Jan 2020 11:45:37 -0800 (PST) MIME-Version: 1.0 From: Elkhan Dadashov Date: Fri, 17 Jan 2020 11:45:01 -0800 Message-ID: Subject: ValueState with pure Java class keeping lists/map vs ListState/MapState, which one is a recommended way? To: user , dev Content-Type: multipart/alternative; boundary="000000000000897674059c5b2f9a" --000000000000897674059c5b2f9a Content-Type: text/plain; charset="UTF-8" Hi Flinkers, Was curious about if there is any performance(memory/speed) difference between these two options: in window process functions, when keeping state: *1) Create a single ValueState, and store state in pure Java objects* class MyClass { List listOtherClass; Map mapKeyToSomeValue; } public class MyProcessFunc extends KeyedProcessFunction> { ... ValueState valueState; ... } vs *2) Create ListState and MapState as 2 Flink state variables:* public class MyProcessFunc extends KeyedProcessFunction> { ... ListState listState; MapState mapState; ... } Which option is a recommended way of storing the states? Thanks. --000000000000897674059c5b2f9a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Flinkers,

Was curious about if there= is any performance(memory/speed) difference between these two options:

in window process functions, when keeping state:

1) Create a single ValueState<MyClass>, and s= tore state in pure Java objects

class MyClass = {
=C2=A0 =C2=A0List<OtherClass> listOtherClass;
= =C2=A0 =C2=A0Map<String, SomeOtherClass> mapKeyToSomeValue;
}

public class MyProcessFunc
=C2=A0 =C2=A0 =C2= =A0 extends KeyedProcessFunction<String, X, Tuple3<Long, Long, Float&= gt;> {
...
=C2=A0 =C2=A0ValueState<MyClass>= ; valueState;
...
}

vs

2) Create ListState and MapState as 2 Flink state vari= ables:

public class MyProcessFunc
=C2=A0 = =C2=A0 =C2=A0 extends KeyedProcessFunction<String, X, Tuple3<Long, Lo= ng, Float>> {
...
=C2=A0 =C2=A0ListState<O= therClass> listState;
=C2=A0 =C2=A0MapState<String, SomeOth= erClass> mapState;
...
}

Wh= ich option is a recommended way of storing the states?

=
Thanks.
--000000000000897674059c5b2f9a--