From user-return-23791-archive-asf-public=cust-asf.ponee.io@flink.apache.org Sat Oct 20 12:30:05 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id AD1A2180668 for ; Sat, 20 Oct 2018 12:30:04 +0200 (CEST) Received: (qmail 79439 invoked by uid 500); 20 Oct 2018 10:30:03 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 79428 invoked by uid 99); 20 Oct 2018 10:30:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 20 Oct 2018 10:30:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id EECE41807DE for ; Sat, 20 Oct 2018 10:30:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.138 X-Spam-Level: ** X-Spam-Status: No, score=2.138 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 83FMtj66dqEy for ; Sat, 20 Oct 2018 10:29:57 +0000 (UTC) Received: from mail-it1-f172.google.com (mail-it1-f172.google.com [209.85.166.172]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id CD8B45F16F for ; Sat, 20 Oct 2018 10:29:56 +0000 (UTC) Received: by mail-it1-f172.google.com with SMTP id c23-v6so7021133itd.5 for ; Sat, 20 Oct 2018 03:29:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=58xKncIpbncUeFmBmm/DsozzQv97NNhjrLC5EjjmOX4=; b=iHvhkCXPe0u0l3n3GTh8j25jmOKe8C5DtqqI3JmwYMPv8mB+gAdVkEBZPzGBqLb1S+ kENBGjsV5n2kklRZM1y4M+mh8LeRLT2sCXWTRumV4AHhm6jTZFnm7yLE67zRGFOp3NlD tW+odXan90bivGY95rl2llKcT+vBLddv7qihr+mHFkoz4cLFJJCP5XnKAYaEqI4d+WlI +cJHQpX2IjDGW8F29ndGyTlVg93JomNx8alZcqGsGl53ujnuOubGUDuS9inZhi8cDtrq J9nsQIUEVPPb0UAjUCKb1IFSI8ZLLqKKsYuGPir8oWdIAyxUsevtRQaNH0PVjOe0hrEu 7EPw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=58xKncIpbncUeFmBmm/DsozzQv97NNhjrLC5EjjmOX4=; b=J4MVCCeBYvQy3OEAsxmEWwzUJOS/4PUEHb5UuoXGprr9o946Of+7QKwoV1XTvlcWPI Dl4paDaml4n3/q6A6KTjcA85DmVGDE/4+zE08ptGrPIOOzyCDfKbkeOJtaYUIgKs07Yn OYJXlSwCf7c5S5QW7cA0gRhZ+V/0QZg/wLkhqTK/TP2dglI+mTDQ7gJ+RPeNsCSrrf+t 4jrYmFl0xUNisDo/tozTWFsNnWzG5ysuCJQBzLgmjMvHXGPTjrD2MWIESctoM+RBi+mO vMkAchQQ2I4NXqNnOGRfnMDC28KZtYrd61IJB3UwfVSaDKcwDDlKgEwHWYlHGoOUX6A9 tXmA== X-Gm-Message-State: ABuFfohtI0qhsRJnVjmr6zUvu+rkuXIc0FDYz+eC/70kEsEPxvtCQ/hQ LwhlUb4sCiVafhdHggyjmdh/AoOPhcmUBvD1RTk= X-Google-Smtp-Source: ACcGV63X3S6oepsKToe1dthxAt+tmR+4fE4Y/rDVXDfeHBjFCOTEUdERBm5mEbTTTe2jyQa2uCP33OzETLeJer/ctHU= X-Received: by 2002:a02:6066:: with SMTP id d38-v6mr28348613jaf.101.1540031390589; Sat, 20 Oct 2018 03:29:50 -0700 (PDT) MIME-Version: 1.0 References: <2AA92376-18B6-468B-A2C7-D15FFA680064@gmail.com> In-Reply-To: <2AA92376-18B6-468B-A2C7-D15FFA680064@gmail.com> From: vino yang Date: Sat, 20 Oct 2018 18:29:41 +0800 Message-ID: Subject: Re: Initializing mapstate hangs To: Ahmad Hassan Cc: user , s.richter@data-artisans.com Content-Type: multipart/alternative; boundary="000000000000faa6b90578a67fa5" --000000000000faa6b90578a67fa5 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Ahmad, Can you try to dump thread info from the Task Manager's JVM instance? Thanks, vino. Ahmad Hassan =E4=BA=8E2018=E5=B9=B410=E6=9C=8820= =E6=97=A5=E5=91=A8=E5=85=AD =E4=B8=8B=E5=8D=884:24=E5=86=99=E9=81=93=EF=BC= =9A > Flink 1.6.0. Valuestate initialises successful but mapstate hangs > > Regards > > On 20 Oct 2018, at 02:55, vino yang wrote: > > Hi Ahmad, > > Which version of Flink do you use? > > Thanks, vino. > > Ahmad Hassan =E4=BA=8E2018=E5=B9=B410=E6=9C=8819= =E6=97=A5=E5=91=A8=E4=BA=94 =E4=B8=8B=E5=8D=8811:32=E5=86=99=E9=81=93=EF=BC= =9A > >> Hi, >> >> Initializing mapstate hangs in window function. However if i use >> valuestate then it is initialized succcessfully. I am using rocksdb to >> store the state. >> >> public class MyWindowFunction extends RichWindowFunction> Tuple, TimeWindow> >> { >> private transient MapStateDescriptor productsDescriptor = =3D >> new MapStateDescriptor<>( >> "mapState", String.class, String.class); >> >> @Override >> public void apply(Tuple key, TimeWindow window, final Iterable >> input, >> final Collector out) >> { >> // do something >> } >> >> @Override >> public void open(Configuration parameters) throws Exception >> { >> System.out.println("## open init window state "); >> * MapState state =3D >> this.getRuntimeContext().getMapState(productsDescriptor); <<< program ha= ngs >> here* >> System.out.println("## open window state " + state); >> } >> } >> >> Thanks for the help. >> > --000000000000faa6b90578a67fa5 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Ahmad,

Can you try to dump thread in= fo from the Task Manager's JVM instance?

Thank= s, vino.

Flink 1.6.0. Valuestate initialises success= ful but mapstate hangs=C2=A0

Regards=C2=A0
Hi Ahmad,

Which version of Flink do you use?

Thanks, v= ino.

Ahmad= Hassan <ahm= ad.hassan@gmail.com> =E4=BA=8E2018=E5=B9=B410=E6=9C=8819=E6=97=A5=E5= =91=A8=E4=BA=94 =E4=B8=8B=E5=8D=8811:32=E5=86=99=E9=81=93=EF=BC=9A
Hi,
<= br>
Initializing mapstate hangs in window function. However if i = use valuestate then it is initialized succcessfully. I am using rocksdb to = store the state.

public class MyWindowFunctio= n extends RichWindowFunction<Event, Payload, Tuple, TimeWindow>
=
{
private transi= ent MapStateDescriptor<String, String> productsDescriptor =3D new Map= StateDescriptor<>(
<= /span>"mapState", String.class, String.class);

@Override
public void apply(Tuple key, TimeWi= ndow window, final Iterable<Event> input,
final Collector<Payload> out)
= {
// do something
}

@Override
<= /span>public void open(Configuration parameters) throws Exception
{
System.out.println("## open init window sta= te ");
MapSt= ate<String, String> state =3D this.getRuntimeContext().getMapState(pr= oductsDescriptor); <<< program hangs here
System.out.println("## open window = state " + state);
}
}

Thanks for the help.
--000000000000faa6b90578a67fa5--