From user-return-21479-archive-asf-public=cust-asf.ponee.io@flink.apache.org Fri Jul 20 21:54:26 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 901B7180663 for ; Fri, 20 Jul 2018 21:54:24 +0200 (CEST) Received: (qmail 58112 invoked by uid 500); 20 Jul 2018 19:54:23 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 58102 invoked by uid 99); 20 Jul 2018 19:54:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Jul 2018 19:54:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id DE8881A1647 for ; Fri, 20 Jul 2018 19:54:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.889 X-Spam-Level: * X-Spam-Status: No, score=1.889 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=lyft.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id NCUz6vOR59AS for ; Fri, 20 Jul 2018 19:54:19 +0000 (UTC) Received: from mail-oi0-f65.google.com (mail-oi0-f65.google.com [209.85.218.65]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id CB8775F3B7 for ; Fri, 20 Jul 2018 19:54:18 +0000 (UTC) Received: by mail-oi0-f65.google.com with SMTP id l10-v6so23363676oii.0 for ; Fri, 20 Jul 2018 12:54:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lyft.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=LiW4BeJTteU+Wpxzv/80QHt2ush6Dx6qnxWFDib3MVE=; b=skzqIVAGu5XInV8+nGg+kkpjdTI0ckPG0xFHpWwqPM94F4Slk6WIPbp7Vu4Ozit69Q jjh2pmrQKdi3bUiAZB1kGd9T+I/SLaYCcoof3q5OOulvDzwPdPcMkfBza6IxXWZNh/g4 9oQD3QeL/VSZu7lsrLIyvs+dGgy1wLiiWqUpE= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=LiW4BeJTteU+Wpxzv/80QHt2ush6Dx6qnxWFDib3MVE=; b=Vys1ElnJiqPj4/IXGqrHPYPcj6s1p36rAwKxNL26NfRxCGkUXH0a4IxJL1MwwXa5QK T1PCHI1We813HstyG8ljCWvZRzQynLGcwxCrsGFlLURakJMnw+DFMYVvZbKWT4GYM9tx z7cFw5iDV0d0l3BPHaXjE0Gql7eHQrF7K7rcsdkMF4V81/v5yrYfyp4fUD1wMzNsXEpB Md8pcaaXSmDEhsyiMJUHty2tBLC6ewtfeZg7WNAXdEAHwzFYFANYDTbqySi2ZINIesnW yVAZJk/mHp3iOhVUKTw0CHoYcjcPK+m6UZGGcxSpEw617+Yp9KMv46WIRtRhKT91YY1+ lH9g== X-Gm-Message-State: AOUpUlGCZxvrmoF/tJ/IdcksHiRzSka7hdKp7jqNWvLpZMeE5uhXt5Yx BE27O2QnM4DF8rjCtxp69ZWj0eeJsy/+OToGj4AUhA== X-Google-Smtp-Source: AAOMgpeycG2W/o05r2DqPWPv0v0KNUtIM9Se1Bc4eFUVRpmtc5YJiF2xRIeo/3uway5TOXcLvIOp62nJU6YNWj/y5hw= X-Received: by 2002:aca:bbc4:: with SMTP id l187-v6mr83416oif.278.1532116457445; Fri, 20 Jul 2018 12:54:17 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a9d:24a:0:0:0:0:0 with HTTP; Fri, 20 Jul 2018 12:53:36 -0700 (PDT) In-Reply-To: References: From: Gregory Fee Date: Fri, 20 Jul 2018 12:53:36 -0700 Message-ID: Subject: Re: org.apache.flink.streaming.runtime.streamrecord.LatencyMarker cannot be cast to org.apache.flink.streaming.runtime.streamrecord.StreamRecord To: Dawid Wysakowicz Cc: user Content-Type: multipart/alternative; boundary="00000000000033a113057173a9b7" --00000000000033a113057173a9b7 Content-Type: text/plain; charset="UTF-8" This is on Flink 1.4.2. I filed it as Flink-9905. Thanks! On Fri, Jul 20, 2018 at 2:51 AM, Dawid Wysakowicz wrote: > Hi Gregory, > I think it is some flink bug. Could you file a JIRA for it? Also which > version of flink are you using? > Best, > Dawid > > On Fri, 20 Jul 2018 at 04:34, vino yang wrote: > >> Hi Gregory, >> >> This exception seems a bug, you can create a issues in the JIRA. >> >> Thanks, vino. >> >> 2018-07-20 10:28 GMT+08:00 Philip Doctor : >> >>> Oh you were asking about the cast exception, I haven't seen that before, >>> sorry to be off topic. >>> >>> >>> >>> >>> ------------------------------ >>> *From:* Philip Doctor >>> *Sent:* Thursday, July 19, 2018 9:27:15 PM >>> *To:* Gregory Fee; user >>> *Subject:* Re: org.apache.flink.streaming.runtime.streamrecord.LatencyMarker >>> cannot be cast to org.apache.flink.streaming.runtime.streamrecord. >>> StreamRecord >>> >>> >>> >>> I'm just a flink user, not an expert. I've seen that exception before. >>> I have never seen it be the actual error, I usually see it when some other >>> operator is throwing an uncaught exception and busy dying. It seems to me >>> that the prior operator throws this error "Can't forward to the next >>> operator" why? because the next operator's already dead, but the job is >>> busy dying asynchronously, so you get a cloud of errors that sort of >>> surround the root cause. I'd read your logs a little further back. >>> ------------------------------ >>> *From:* Gregory Fee >>> *Sent:* Thursday, July 19, 2018 9:10:37 PM >>> *To:* user >>> *Subject:* org.apache.flink.streaming.runtime.streamrecord.LatencyMarker >>> cannot be cast to org.apache.flink.streaming.runtime.streamrecord. >>> StreamRecord >>> >>> Hello, I have a job running and I've gotten this error a few times. The >>> job recovers from a checkpoint and seems to continue forward fine. Then the >>> error will happen again sometime later, perhaps 1 hour. This looks like a >>> Flink bug to me but I could use an expert opinion. Thanks! >>> >>> org.apache.flink.streaming.runtime.tasks.ExceptionInChainedOperatorException: >>> Could not forward element to next operator >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.pushToOperator(OperatorChain.java:566) >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.collect(OperatorChain.java:524) >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.collect(OperatorChain.java:504) >>> >>> at org.apache.flink.streaming.api.operators.AbstractStreamOperator$ >>> CountingOutput.collect(AbstractStreamOperator.java:830) >>> >>> at org.apache.flink.streaming.api.operators.AbstractStreamOperator$ >>> CountingOutput.collect(AbstractStreamOperator.java:808) >>> >>> at com.lyft.streamingplatform.BetterBuffer$OutputThread.run( >>> BetterBuffer.java:316) >>> >>> Caused by: org.apache.flink.streaming.runtime.tasks. >>> ExceptionInChainedOperatorException: Could not forward element to next >>> operator >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.pushToOperator(OperatorChain.java:566) >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.collect(OperatorChain.java:524) >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.collect(OperatorChain.java:504) >>> >>> at org.apache.flink.streaming.api.operators.AbstractStreamOperator$ >>> CountingOutput.collect(AbstractStreamOperator.java:830) >>> >>> at org.apache.flink.streaming.api.operators.AbstractStreamOperator$ >>> CountingOutput.collect(AbstractStreamOperator.java:808) >>> >>> at org.apache.flink.streaming.api.operators. >>> TimestampedCollector.collect(TimestampedCollector.java:51) >>> >>> at com.lyft.dsp.functions.Labeler$UnlabelerFunction. >>> processElement(Labeler.java:67) >>> >>> at com.lyft.dsp.functions.Labeler$UnlabelerFunction. >>> processElement(Labeler.java:48) >>> >>> at org.apache.flink.streaming.api.operators.ProcessOperator. >>> processElement(ProcessOperator.java:66) >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.pushToOperator(OperatorChain.java:549) >>> >>> ... 5 more >>> >>> Caused by: org.apache.flink.streaming.runtime.tasks. >>> ExceptionInChainedOperatorException: Could not forward element to next >>> operator >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.pushToOperator(OperatorChain.java:566) >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.collect(OperatorChain.java:524) >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.collect(OperatorChain.java:504) >>> >>> at org.apache.flink.streaming.api.operators.AbstractStreamOperator$ >>> CountingOutput.collect(AbstractStreamOperator.java:830) >>> >>> at org.apache.flink.streaming.api.operators.AbstractStreamOperator$ >>> CountingOutput.collect(AbstractStreamOperator.java:808) >>> >>> at org.apache.flink.streaming.api.operators. >>> TimestampedCollector.collect(TimestampedCollector.java:51) >>> >>> at org.apache.flink.table.runtime.CRowWrappingCollector. >>> collect(CRowWrappingCollector.scala:37) >>> >>> at org.apache.flink.table.runtime.CRowWrappingCollector. >>> collect(CRowWrappingCollector.scala:28) >>> >>> at DataStreamSourceConversion$14.processElement(Unknown Source) >>> >>> at org.apache.flink.table.runtime.CRowOutputProcessRunner. >>> processElement(CRowOutputProcessRunner.scala:67) >>> >>> at org.apache.flink.streaming.api.operators.ProcessOperator. >>> processElement(ProcessOperator.java:66) >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.pushToOperator(OperatorChain.java:549) >>> >>> ... 14 more >>> >>> Caused by: java.lang.RuntimeException: org.apache.flink.streaming. >>> runtime.streamrecord.LatencyMarker cannot be cast to >>> org.apache.flink.streaming.runtime.streamrecord.StreamRecord >>> >>> at org.apache.flink.streaming.runtime.io.RecordWriterOutput. >>> pushToRecordWriter(RecordWriterOutput.java:105) >>> >>> at org.apache.flink.streaming.runtime.io.RecordWriterOutput. >>> collect(RecordWriterOutput.java:84) >>> >>> at org.apache.flink.streaming.runtime.io.RecordWriterOutput. >>> collect(RecordWriterOutput.java:42) >>> >>> at org.apache.flink.streaming.api.operators.AbstractStreamOperator$ >>> CountingOutput.collect(AbstractStreamOperator.java:830) >>> >>> at org.apache.flink.streaming.api.operators.AbstractStreamOperator$ >>> CountingOutput.collect(AbstractStreamOperator.java:808) >>> >>> at org.apache.flink.streaming.api.operators. >>> TimestampedCollector.collect(TimestampedCollector.java:51) >>> >>> at org.apache.flink.table.runtime.CRowWrappingCollector. >>> collect(CRowWrappingCollector.scala:37) >>> >>> at org.apache.flink.table.runtime.CRowWrappingCollector. >>> collect(CRowWrappingCollector.scala:28) >>> >>> at DataStreamCalcRule$37.processElement(Unknown Source) >>> >>> at org.apache.flink.table.runtime.CRowProcessRunner.processElement( >>> CRowProcessRunner.scala:66) >>> >>> at org.apache.flink.table.runtime.CRowProcessRunner.processElement( >>> CRowProcessRunner.scala:35) >>> >>> at org.apache.flink.streaming.api.operators.ProcessOperator. >>> processElement(ProcessOperator.java:66) >>> >>> at org.apache.flink.streaming.runtime.tasks.OperatorChain$ >>> CopyingChainingOutput.pushToOperator(OperatorChain.java:549) >>> >>> ... 25 more >>> >>> Caused by: java.lang.ClassCastException: org.apache.flink.streaming. >>> runtime.streamrecord.LatencyMarker cannot be cast to >>> org.apache.flink.streaming.runtime.streamrecord.StreamRecord >>> >>> at org.apache.flink.streaming.runtime.partitioner. >>> KeyGroupStreamPartitioner.selectChannels(KeyGroupStreamPartitioner. >>> java:61) >>> >>> at org.apache.flink.streaming.runtime.partitioner. >>> KeyGroupStreamPartitioner.selectChannels(KeyGroupStreamPartitioner. >>> java:32) >>> >>> at org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit( >>> RecordWriter.java:88) >>> >>> at org.apache.flink.streaming.runtime.io.StreamRecordWriter. >>> emit(StreamRecordWriter.java:84) >>> >>> at org.apache.flink.streaming.runtime.io.RecordWriterOutput. >>> pushToRecordWriter(RecordWriterOutput.java:102) >>> >>> ... 37 more >>> >>> -- >>> *Gregory Fee* >>> Engineer >>> 425.830.4734 <+14258304734> >>> [image: Lyft] >>> >> >> -- *Gregory Fee* Engineer 425.830.4734 <+14258304734> [image: Lyft] --00000000000033a113057173a9b7 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
This is on Flink 1.4.2. I filed it as Flink-9905. Thanks!<= /div>

On Fri, Jul = 20, 2018 at 2:51 AM, Dawid Wysakowicz <dwysakowicz@apache.org>= wrote:
Hi G= regory,
I think it is some flink bug. Could you file a JIRA for i= t? Also which version of flink are you using?
Best,
Daw= id

On Fri, 2= 0 Jul 2018 at 04:34, vino yang <yanghua1127@gmail.com> wrote:
Hi Gregory,

This e= xception seems a bug, you can create a issues in the JIRA.=C2=A0
=
Thanks, vino.

2018-07-20 10:28 GMT+08:00 Philip Doctor <= philip.doctor@physiq.com>:

Oh you were asking about the cast= exception, I haven't seen that before, sorry to be off topic.




From: Philip Doctor <philip.doctor@physiq.com= >
Sent: Thursday, July 19, 2018 9:27:15 PM
To: Gregory Fee; user
Subject: Re: org.apache.flink.streaming.runtime.streamrecord.LatencyMarker cannot be cast to org.apache.flink.streaming.runtime.= streamrecord.StreamRecord
=C2=A0


I'm just a flink user, not an= expert.=C2=A0 I've seen that exception before.=C2=A0 I have never seen= it be=C2=A0the actual error, I usually see it when some other operator is = throwing an uncaught exception and busy dying.=C2=A0 It seems to me that the prior operator throws this error "Can't forward to= the next operator" why? because the next operator's already dead,= but the job is busy dying asynchronously, so you get a cloud of errors tha= t sort of surround the root cause.=C2=A0 I'd read your logs a little further back.

From: Gregory Fee <gfee@lyft.com>
Sent: Thursday, July 19, 2018 9:10:37 PM
To: user
Subject: org.apache.flink.streaming.runtime.streamrecord.L= atencyMarker cannot be cast to org.apache.flink.streaming.runtime.stre= amrecord.StreamRecord
=C2=A0
Hello, I have a job running and I've gotten this error a few times= . The job recovers from a checkpoint and seems to continue forward fine. Th= en the error will happen again sometime later, perhaps 1 hour. This looks l= ike a Flink bug to me but I could use an expert opinion. Thanks!

org.apache.flink.streaming.runtime.tasks.ExceptionInChained= OperatorException: Could not forward element to next operator

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.pushToOperator(OperatorChain.java:566)

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.collect(OperatorChain.java:524)

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.collect(OperatorChain.java:504)

at= org.apache.flink.streaming.api.operators.AbstractStreamOperator$= CountingOutput.collect(AbstractStreamOperator.java:830)

at= org.apache.flink.streaming.api.operators.AbstractStreamOperator$= CountingOutput.collect(AbstractStreamOperator.java:808)

at= com.lyft.streamingplatform.BetterBuffer$OutputThread.run(BetterB= uffer.java:316)

Caused by: org.apache.flink.streaming.runtime.tasks.Excepti= onInChainedOperatorException: Could not forward element to next operat= or

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.pushToOperator(OperatorChain.java:566)

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.collect(OperatorChain.java:524)

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.collect(OperatorChain.java:504)

at= org.apache.flink.streaming.api.operators.AbstractStreamOperator$= CountingOutput.collect(AbstractStreamOperator.java:830)

at= org.apache.flink.streaming.api.operators.AbstractStreamOperator$= CountingOutput.collect(AbstractStreamOperator.java:808)

at= org.apache.flink.streaming.api.operators.TimestampedCollector.co= llect(TimestampedCollector.java:51)

at= com.lyft.dsp.functions.Labeler$UnlabelerFunction.processElement(= Labeler.java:67)

at= com.lyft.dsp.functions.Labeler$UnlabelerFunction.processElement(= Labeler.java:48)

at= org.apache.flink.streaming.api.operators.ProcessOperator.process= Element(ProcessOperator.java:66)

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.pushToOperator(OperatorChain.java:549)

..= . 5 more

Caused by: org.apache.flink.streaming.runtime.tasks.Excepti= onInChainedOperatorException: Could not forward element to next operat= or

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.pushToOperator(OperatorChain.java:566)

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.collect(OperatorChain.java:524)

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.collect(OperatorChain.java:504)

at= org.apache.flink.streaming.api.operators.AbstractStreamOperator$= CountingOutput.collect(AbstractStreamOperator.java:830)

at= org.apache.flink.streaming.api.operators.AbstractStreamOperator$= CountingOutput.collect(AbstractStreamOperator.java:808)

at= org.apache.flink.streaming.api.operators.TimestampedCollector.co= llect(TimestampedCollector.java:51)

at= org.apache.flink.table.runtime.CRowWrappingCollector.collect(CRo= wWrappingCollector.scala:37)

at= org.apache.flink.table.runtime.CRowWrappingCollector.collect(CRo= wWrappingCollector.scala:28)

at= DataStreamSourceConversion$14.processElement(Unknown Source)

at= org.apache.flink.table.runtime.CRowOutputProcessRunner.proc= essElement(CRowOutputProcessRunner.scala:67)

at= org.apache.flink.streaming.api.operators.ProcessOperator.process= Element(ProcessOperator.java:66)

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.pushToOperator(OperatorChain.java:549)

..= . 14 more

Caused by: java.lang.RuntimeException: org.apache.flink.streaming.runtime.streamrecord.LatencyMarker cannot be cast to org.apache.flin= k.streaming.runtime.streamrecord.StreamRecord

at= org.apache.flink.streaming.runtime.io.RecordWriterOutput.pushToR= ecordWriter(RecordWriterOutput.java:105)

at= org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect= (RecordWriterOutput.java:84)

at= org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect= (RecordWriterOutput.java:42)

at= org.apache.flink.streaming.api.operators.AbstractStreamOperator$= CountingOutput.collect(AbstractStreamOperator.java:830)

at= org.apache.flink.streaming.api.operators.AbstractStreamOperator$= CountingOutput.collect(AbstractStreamOperator.java:808)

at= org.apache.flink.streaming.api.operators.TimestampedCollector.co= llect(TimestampedCollector.java:51)

at= org.apache.flink.table.runtime.CRowWrappingCollector.collect(CRo= wWrappingCollector.scala:37)

at= org.apache.flink.table.runtime.CRowWrappingCollector.collect(CRo= wWrappingCollector.scala:28)

at= DataStreamCalcRule$37.processElement(Unknown Source)

at= org.apache.flink.table.runtime.CRowProcessRunner.processElement(= CRowProcessRunner.scala:66)

at= org.apache.flink.table.runtime.CRowProcessRunner.processElement(= CRowProcessRunner.scala:35)

at= org.apache.flink.streaming.api.operators.ProcessOperator.process= Element(ProcessOperator.java:66)

at= org.apache.flink.streaming.runtime.tasks.OperatorChain$CopyingCh= ainingOutput.pushToOperator(OperatorChain.java:549)

..= . 25 more

Caused by: java.lang.ClassCastException: org.apache.flink.streaming.<= wbr>runtime.streamrecord.LatencyMarker cannot be cast to org.apache.fl= ink.streaming.runtime.streamrecord.StreamRecord

at= org.apache.flink.streaming.runtime.partitioner.KeyGroupStreamPar= titioner.selectChannels(KeyGroupStreamPartitioner.java:61)

at= org.apache.flink.streaming.runtime.partitioner.KeyGroupStreamPar= titioner.selectChannels(KeyGroupStreamPartitioner.java:32)

at= org.apach= e.flink.runtime.io.network.api.writer.RecordWriter.emit(= RecordWriter.java:88)

at= org.apache.flink.streaming.runtime.io.StreamRecordWriter.emit(St= reamRecordWriter.java:84)

at= org.apache.flink.streaming.runtime.io.RecordWriterOutput.pushToR= ecordWriter(RecordWriterOutput.java:102)

..= . 37 more


--
Gregory Fee
Engineer
425.830.4734
3D"Lyft"




--
=
En= gineer
425.830.4734
3D"Lyft"
=
--00000000000033a113057173a9b7--