From issues-return-520529-archive-asf-public=cust-asf.ponee.io@flink.apache.org Fri Aug 6 09:37:03 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id C4700180181 for ; Fri, 6 Aug 2021 11:37:02 +0200 (CEST) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id D81804473A for ; Fri, 6 Aug 2021 09:37:01 +0000 (UTC) Received: (qmail 11729 invoked by uid 500); 6 Aug 2021 09:37:01 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 11714 invoked by uid 99); 6 Aug 2021 09:37:01 -0000 Received: from mailrelay1-he-de.apache.org (HELO mailrelay1-he-de.apache.org) (116.203.21.61) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Aug 2021 09:37:01 +0000 Received: from jira2-he-de.apache.org (jira2-he-de.apache.org [168.119.33.54]) by mailrelay1-he-de.apache.org (ASF Mail Server at mailrelay1-he-de.apache.org) with ESMTPS id 6C9293E8B2 for ; Fri, 6 Aug 2021 09:37:00 +0000 (UTC) Received: from jira2-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira2-he-de.apache.org (ASF Mail Server at jira2-he-de.apache.org) with ESMTP id 5217CC80685 for ; Fri, 6 Aug 2021 09:37:00 +0000 (UTC) Date: Fri, 6 Aug 2021 09:37:00 +0000 (UTC) From: "guxiang (Jira)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-18464) ClassCastException during namespace serialization for checkpoint (Heap and RocksDB) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/FLINK-18464?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D173= 94656#comment-17394656 ]=20 guxiang commented on FLINK-18464: --------------------------------- Hi=C2=A0=C2=A0[~yunta]=C2=A0,=C2=A0[~roman_khachatryan]=C2=A0 I wonder what you think about it.=C2=A0=C2=A0Your suggestions are very impo= rtant=C2=A0=C2=A0and I am looking forward to your reply.=C2=A0 If you have = time, I want you to review my code and my above ideas.=C2=A0 Thank you very= much.. > ClassCastException during namespace serialization for checkpoint (Heap an= d RocksDB) > -------------------------------------------------------------------------= ---------- > > Key: FLINK-18464 > URL: https://issues.apache.org/jira/browse/FLINK-18464 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing, Runtime / State Backends > Affects Versions: 1.9.3, 1.13.1 > Reporter: Roman Khachatryan > Priority: Major > Labels: pull-request-available > Attachments: image-2021-06-21-20-06-51-323.png, image-2021-06-21-= 20-07-30-281.png, image-2021-06-21-20-07-43-246.png, image-2021-06-21-20-33= -39-295.png, image-2021-06-23-14-34-37-703.png, image-2021-06-24-16-41-54-4= 25.png, image-2021-06-24-17-51-53-734.png, image-2021-07-08-14-50-12-559.pn= g, image-2021-07-08-18-33-17-417.png, image-2021-07-08-18-34-51-910.png, im= age-2021-07-19-14-40-17-398.png, image-2021-07-19-14-44-59-511.png, image-2= 021-07-19-14-46-21-682.png, image-2021-07-19-14-47-34-111.png, image-2021-0= 7-19-15-20-36-431.png, image-2021-07-19-15-21-04-214.png, image-2021-07-19-= 15-45-53-014.png, image-2021-07-19-15-48-23-853.png > > > (see=C2=A0FLINK-23036 for error details with RocksDB) > =C2=A0 > From [thread|http://apache-flink-user-mailing-list-archive.2336050.n4.nab= ble.com/Checkpoint-failed-because-of-TimeWindow-cannot-be-cast-to-VoidNames= pace-td36310.html] > {quote}I'm using flink 1.9 on Mesos and I try to use my own trigger and e= victor. The state is stored to memory. > {quote} > =C2=A0 > =C2=A0 > {code:java} > input.setParallelism(processParallelism) > =C2=A0 =C2=A0 =C2=A0 =C2=A0 .assignTimestampsAndWatermarks(new UETimeAssi= gner) > =C2=A0 =C2=A0 =C2=A0 =C2=A0 .keyBy(_.key) > =C2=A0 =C2=A0 =C2=A0 =C2=A0 .window(TumblingEventTimeWindows.of(Time.minu= tes(20))) > =C2=A0 =C2=A0 =C2=A0 =C2=A0 .trigger(new MyTrigger) > =C2=A0 =C2=A0 =C2=A0 =C2=A0 .evictor(new MyEvictor) > =C2=A0 =C2=A0 =C2=A0 =C2=A0 .process(new MyFunction).setParallelism(aggre= gateParallelism) > =C2=A0 =C2=A0 =C2=A0 =C2=A0 .addSink(kafkaSink).setParallelism(sinkParall= elism) > =C2=A0 =C2=A0 =C2=A0 =C2=A0 .name("kafka-record-sink"){code} > =C2=A0 > =C2=A0 > {code:java} > java.lang.Exception: Could not materialize checkpoint 1 for operator Wind= ow(TumblingEventTimeWindows(1200000), JoinTrigger, JoinEvictor, ScalaProces= sWindowFunctionWrapper) -> Sink: kafka-record-sink (2/5). > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.streaming.runtime.tasks.Stre= amTask$AsyncCheckpointRunnable.handleExecutionException(StreamTask.java:110= 0) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.streaming.runtime.tasks.Stre= amTask$AsyncCheckpointRunnable.run(StreamTask.java:1042) > =C2=A0=C2=A0=C2=A0=C2=A0at java.util.concurrent.ThreadPoolExecutor.runWo= rker(ThreadPoolExecutor.java:1149) > =C2=A0=C2=A0=C2=A0=C2=A0at java.util.concurrent.ThreadPoolExecutor$Worke= r.run(ThreadPoolExecutor.java:624) > =C2=A0=C2=A0=C2=A0=C2=A0at java.lang.Thread.run(Thread.java:748) > Caused by: java.util.concurrent.ExecutionException: java.lang.ClassCastEx= ception: org.apache.flink.streaming.api.windowing.windows.TimeWindow cannot= be cast to org.apache.flink.runtime.state.VoidNamespace > =C2=A0=C2=A0=C2=A0=C2=A0at java.util.concurrent.FutureTask.report(Future= Task.java:122) > =C2=A0=C2=A0=C2=A0=C2=A0at java.util.concurrent.FutureTask.get(FutureTas= k.java:192) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.runtime.concurrent.FutureUti= ls.runIfNotDoneAndGet(FutureUtils.java:450) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.streaming.api.operators.Oper= atorSnapshotFinalizer.(OperatorSnapshotFinalizer.java:47) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.streaming.runtime.tasks.Stre= amTask$AsyncCheckpointRunnable.run(StreamTask.java:1011) =C2=A0=C2=A0=C2=A0= =C2=A0 > ... 3 more=20 > Caused by: java.lang.ClassCastException: org.apache.flink.streaming.api.w= indowing.windows.TimeWindow cannot be cast to org.apache.flink.runtime.stat= e.VoidNamespace > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.runtime.state.VoidNamespaceS= erializer.serialize(VoidNamespaceSerializer.java:32) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.runtime.state.heap.CopyOnWri= teStateMapSnapshot.writeState(CopyOnWriteStateMapSnapshot.java:114) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.runtime.state.heap.AbstractS= tateTableSnapshot.writeStateInKeyGroup(AbstractStateTableSnapshot.java:121) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.runtime.state.heap.CopyOnWri= teStateTableSnapshot.writeStateInKeyGroup(CopyOnWriteStateTableSnapshot.jav= a:37) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.runtime.state.heap.HeapSnaps= hotStrategy$1.callInternal(HeapSnapshotStrategy.java:191) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.runtime.state.heap.HeapSnaps= hotStrategy$1.callInternal(HeapSnapshotStrategy.java:158) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.runtime.state.AsyncSnapshotC= allable.call(AsyncSnapshotCallable.java:75) > =C2=A0=C2=A0=C2=A0=C2=A0at java.util.concurrent.FutureTask.run(FutureTas= k.java:266) > =C2=A0=C2=A0=C2=A0=C2=A0at org.apache.flink.runtime.concurrent.FutureUti= ls.runIfNotDoneAndGet(FutureUtils.java:447) =C2=A0=C2=A0=C2=A0 > =C2=A0 =C2=A0 =C2=A0... 5 more > {code} > =C2=A0 > =C2=A0 -- This message was sent by Atlassian Jira (v8.3.4#803005)