From user-return-23649-archive-asf-public=cust-asf.ponee.io@flink.apache.org Fri Oct 12 14:14:54 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id B876D180660 for ; Fri, 12 Oct 2018 14:14:53 +0200 (CEST) Received: (qmail 43160 invoked by uid 500); 12 Oct 2018 12:14:52 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 43150 invoked by uid 99); 12 Oct 2018 12:14:52 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Oct 2018 12:14:52 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 106E51A0850 for ; Fri, 12 Oct 2018 12:14:52 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.138 X-Spam-Level: ** X-Spam-Status: No, score=2.138 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id nAy2yj7ar9XG for ; Fri, 12 Oct 2018 12:14:51 +0000 (UTC) Received: from mail-it1-f178.google.com (mail-it1-f178.google.com [209.85.166.178]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 453175F3ED for ; Fri, 12 Oct 2018 12:14:45 +0000 (UTC) Received: by mail-it1-f178.google.com with SMTP id 134-v6so18363730itz.2 for ; Fri, 12 Oct 2018 05:14:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=NBIjGbapZ+hKQDKz92Dtyu5FL7adOq9wjuUc1X8zYbs=; b=SHMqE5JpALZC02JMgQg1I7BOrFpwBKWMJk/vuMr7Q7ubpSXceBq9jh8+z/+gFWVaAt xkiu5V2vcJoUG1Sdx23Q8avFgI8Y8vu9NT3wm3H6JR+Y9EAreS0WtsncKDNjg0jSLjdl GdMI6gSW9fPirv70YICf0UdXuyE5rFqN6smfDruGCQJvFQOcKoHQasTs6A8dUNK35fiy Zq43UBamYv5hNJQDSFlWhalItotQsYOT9LORx0AW1PWrNvBuuK/xvdQh6VfhcGamlsJE npA2wQtNJfXPyIVx7dmAiApKpuKh/XNssZ7puu1/Yf0w8hbvsPe/QBM8vbHwH/whj1qN 2Q2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=NBIjGbapZ+hKQDKz92Dtyu5FL7adOq9wjuUc1X8zYbs=; b=OL1/izQNJXjTZVx/SAqtxlyBTkFXYLd2r/YsB9nDQITICuLGgw4EKu6wTPH5ToErrM N3D5tQ/fW0MKUUbBCeCxIO06Q7ozKxjOEhGYqaUXgnEGjP/2hiXO7mdexlGVJnyHvYPL /KFDxJsa4c2qNtNePJdSGnGZvWMyOJymLO6rQ9rvHDMXSh1BDFQJjfq3Cgo0kJQUGF+J l90QCk/Za3ZYdeEil8QzRsBhlqdXzZ6hqp67p10Ly4SKn+0AJqCGbboxpkOBjCLMmZ0/ nWiLb+XgeWnOBZp7SxYnKw/pak8qwEAujSsFt5jiR8jWLDKNxm0L5kHUArXnvaTcug/O 1eyQ== X-Gm-Message-State: ABuFfoghIMxc8rCrJdcTDtBK/GbVy/9UR1BGV/T98MlvpxC6Fnrd84mO MIfQ6McirFaT3h6yhYP3PS5sVICG675lhXrPIk1T88HN9tU= X-Google-Smtp-Source: ACcGV61KVM2ggwRHyTkSGcH8mG/5NzuQ/SCYfG5tqoxITVAFIYg2jerGEiVsfbquhnuM4gC8BCfJ703DDBQy82Z/n8s= X-Received: by 2002:a24:4f82:: with SMTP id c124-v6mr4750499itb.108.1539346484144; Fri, 12 Oct 2018 05:14:44 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Congxian Qiu Date: Fri, 12 Oct 2018 20:14:32 +0800 Message-ID: Subject: Re: How do I initialize the window state on first run? To: bupt_ljy@163.com Cc: yanghua1127@gmail.com, user Content-Type: multipart/alternative; boundary="0000000000005fadeb0578070865" --0000000000005fadeb0578070865 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable IIUC, we can't initialize state at first run, maybe you could store the aggregated data in another place other than use flink's state, then use flink to aggregate the data realtime. bupt_ljy =E4=BA=8E2018=E5=B9=B410=E6=9C=8812=E6=97=A5=E5= =91=A8=E4=BA=94 =E4=B8=8B=E5=8D=883:33=E5=86=99=E9=81=93=EF=BC=9A > Hi, vivo, > > My Flink program is to aggregate the data of a whole day, assume we > start this program on 6:00 am, the default state in the window should be > the aggregated result of 0:00 am to 6:00 am. > > Original Message > *Sender:* vino yang > *Recipient:* bupt_ljy > *Cc:* user > *Date:* Friday, Oct 12, 2018=E2=80=8715:13 > *Subject:* Re: How do I initialize the window state on first run? > > Hi Jiayi, > > If you don't mind, I would like to ask you what kind of situation do you > have in this situation? > > Thanks, vino. > > bupt_ljy =E4=BA=8E2018=E5=B9=B410=E6=9C=8812=E6=97=A5= =E5=91=A8=E4=BA=94 =E4=B8=8B=E5=8D=881:59=E5=86=99=E9=81=93=EF=BC=9A > >> Hi, >> >> I=E2=80=99m going to run a new Flink program with some initialized wi= ndow >> states. >> >> I can=E2=80=99t see there is an official way to do this, right? I=E2= =80=99ve tried the >> bravo project, but it doesn=E2=80=99t support FsStateBackend and it cost= s too much >> work if we add a new StateBackend in it. >> >> Any good ideas about this? >> >> >> >> >> Jiayi Liao,Best >> >> >> > --=20 Blog:http://www.klion26.com GTalk:qcx978132955 =E4=B8=80=E5=88=87=E9=9A=8F=E5=BF=83 --0000000000005fadeb0578070865 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
IIUC, we can't=C2=A0 initialize state at first run,=C2= =A0 maybe you could store the aggregated data in another place other than u= se flink's state, then use flink to aggregate the data realtime.
bupt_ljy <bupt_ljy@163.com> =E4=BA=8E2018=E5=B9=B410=E6=9C= =8812=E6=97=A5=E5=91=A8=E4=BA=94 =E4=B8=8B=E5=8D=883:33=E5=86=99=E9=81=93= =EF=BC=9A

Hi, vivo,

=C2=A0 =C2=A0 = My Flink program is to aggregate the data of a whole day, assume we start t= his program on 6:00 am, the default state in the window should be the aggre= gated result of 0:00 am to 6:00 am.


=C2=A0Or= iginal Message=C2=A0
Sender:=C2=A0vino yang<yanghua1127@gmail.c= om>
Recipient:=C2=A0bupt_ljy&l= t;bupt_ljy@163.com>
Cc:=C2=A0user<user@flink.apache.org><= /div>
Date:=C2=A0Friday, Oct 12, 2018=E2=80= =8715:13
Subject:=C2=A0Re: How do I i= nitialize the window state on first run?

Hi Jiayi,

If you don't mind, I would like to ask= you what kind of situation do you have in this situation?
Thanks, vino.

=
bupt_ljy <bupt_ljy@163.com> =E4=BA=8E2018=E5=B9=B410=E6=9C=8812=E6=97= =A5=E5=91=A8=E4=BA=94 =E4=B8=8B=E5=8D=881:59=E5=86=99=E9=81=93=EF=BC=9A
=

Hi,=C2=A0

=C2=A0 =C2=A0I=E2=80=99= m going to run a new Flink program with some initialized window states.=C2= =A0

=C2=A0 = =C2=A0I can=E2=80=99t see there is an official way to do this, right? I=E2= =80=99ve tried the bravo project, but it doesn=E2=80=99t support FsStateBac= kend and it costs too much work if we add a new StateBackend in it.=C2=A0

=C2=A0 =C2=A0= Any good ideas about this?




Jiayi = Liao,Best

= =C2=A0 =C2=A0



--
<= div dir=3D"ltr">
GTalk:qcx978132955
= =E4=B8=80=E5=88=87=E9=9A=8F=E5=BF=83
--0000000000005fadeb0578070865--