From user-return-25983-archive-asf-public=cust-asf.ponee.io@flink.apache.org Fri Feb 15 16:22:20 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 2026F180651 for ; Fri, 15 Feb 2019 17:22:18 +0100 (CET) Received: (qmail 47362 invoked by uid 500); 15 Feb 2019 16:22:17 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 47352 invoked by uid 99); 15 Feb 2019 16:22:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Feb 2019 16:22:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 65E7C183567 for ; Fri, 15 Feb 2019 16:22:17 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.05 X-Spam-Level: ** X-Spam-Status: No, score=2.05 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, KAM_LOTSOFHASH=0.25, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id JvSJrcP0qlwk for ; Fri, 15 Feb 2019 16:22:15 +0000 (UTC) Received: from mail-ot1-f68.google.com (mail-ot1-f68.google.com [209.85.210.68]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 19DBE60D25 for ; Fri, 15 Feb 2019 16:22:15 +0000 (UTC) Received: by mail-ot1-f68.google.com with SMTP id 32so17346987ota.12 for ; Fri, 15 Feb 2019 08:22:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=u+e1P6Y4R5riOgqPSMxV2GhZuQm+XtEjPxl4amI/9rc=; b=vXnfXwE3GaalSvnD5L3lAdA64zOlJ8VAQ7hXEyRm815UQu4Bic3XO8/b6RruHDvJjP M8nnrZVXFLU3M9VR0d9RMwgCqFasvRiKimpcWy9HCOvk32ypJ7OhW3FuKtQPY/BZe94z l19M5SadZ7AoaztQFtJ7En+bHkjT8ZmMSPNI1VOLMB+7vWoPY2OsIxPRCG9ItyXH22K5 xMo669xVHXK1gDGnwRJu4iZ05C92jaHEoPyFxqXXNEit3QhlgDB+0IRypit5eyYnlwZE pCoXK6AtYDwihuVvWm+BgB6Zk/85SBG2eW9tw1AgK/LAWuf2p6+I8UlVuKQVEsu9aRWt 4DTw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=u+e1P6Y4R5riOgqPSMxV2GhZuQm+XtEjPxl4amI/9rc=; b=G92CoTw2tBvBWzqzLeA14aW9DkGcpqt3Zkyg1Qf73Mm/WSSjeJUPJx/Sea7v0xXsF/ RhH9lwY7A0iSAQ5QAwQTXCoB1/UWRHlTnAW8iIZVsYXbyli5vIYGsxQFyqcPfKg3Wu/B /7IE/uyijr4FO8uM9sIVlXwYeFboZiam9+YVc4O7xh4Dfn/IYTG1YkS8AVRbgludTsX8 Pgze7aW6bc1EW7awSFXMZXHkSmi87TQ1GBhEF1OZt79rAfyt+WHNbhZa7cXJLgl/lYON AVjvetG23xsko0g1cFpQm3JTuvpExRqCHhjaGuKSae5frUsMVDuRDNGXrGPVCDU1rODL 54Yg== X-Gm-Message-State: AHQUAuY59GkLEM7kZahNjeOtoTtPhTgg6EKJVh0GFaRmYMsWfnPbnwwC xcSq40p/8+Dl354dUcMdL1MleG75l1yf9yj8O4ehlA== X-Google-Smtp-Source: AHgI3IY7Rxk6K9TN4Wr1MIf+eMWRdyE1I13UwmkT/KZGl9n4DvlnmbA+rh5o7iF6uK/6bM5Xcyf0sFyZGOsCiYIim2Q= X-Received: by 2002:a05:6830:1554:: with SMTP id l20mr5884590otp.295.1550247734021; Fri, 15 Feb 2019 08:22:14 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Mahantesh Patil Date: Fri, 15 Feb 2019 08:22:03 -0800 Message-ID: Subject: Re: Flink Job sometimes does not stop as expected on cancelling. To: user@flink.apache.org Content-Type: multipart/alternative; boundary="0000000000008016140581f12d01" --0000000000008016140581f12d01 Content-Type: text/plain; charset="UTF-8" Hi Team, Following up to check if any of you have faced this issue. If so how to resolve this. Regards, Mahantesh Patil. On Mon, Feb 11, 2019 at 3:50 PM Mahantesh Patil wrote: > Hi Team, > > We have Flink jobs running in cluster mode. When I cancel the job and > check for status it still shows as running. > > Below is logs generated. I do not see any useful information. Could you > guys point me in a right direction to debug this , our flink jobs do heavy > processing , my understanding is on cancelling flink waits till operator > completes processing to store save point. So is it happening because one of > the operator is hung waiting for resource and is there a way to configure > timeout. > > > Appreciate your help. > > > > 10 Jan 2019 20:36:51,490 INFO org.apache.flink.runtime.taskmanager.Task - > Triggering cancellation of task code Source: control -> control-filter > (1/1) (c6f50328bb09ce1ad389e5ea614fc8a9). > 10 Jan 2019 20:36:51,490 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task interaction-details (1/1) > (dc946a863e34f66a95df3a8e8d540cab). > 10 Jan 2019 20:36:51,490 INFO org.apache.flink.runtime.taskmanager.Task - > interaction-details (1/1) (dc946a863e34f66a95df3a8e8d540cab) switched from > RUNNING to CANCELING. > 10 Jan 2019 20:36:51,491 INFO org.apache.flink.runtime.taskmanager.Task - > Triggering cancellation of task code interaction-details (1/1) > (dc946a863e34f66a95df3a8e8d540cab). > 10 Jan 2019 20:36:51,491 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task current-longests (1/1) > (2f1cee63ab479a8e9e492c990311ccc1). > 10 Jan 2019 20:36:51,491 INFO org.apache.flink.runtime.taskmanager.Task - > current-longests (1/1) (2f1cee63ab479a8e9e492c990311ccc1) switched from > RUNNING to CANCELING. > 10 Jan 2019 20:36:51,491 INFO org.apache.flink.runtime.taskmanager.Task - > Triggering cancellation of task code current-longests (1/1) > (2f1cee63ab479a8e9e492c990311ccc1). > 10 Jan 2019 20:36:51,492 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task interactions-count (1/1) > (aff734ce398978cdc3ac40a1e530d0ed). > 10 Jan 2019 20:36:51,492 INFO org.apache.flink.runtime.taskmanager.Task - > interactions-count (1/1) (aff734ce398978cdc3ac40a1e530d0ed) switched from > RUNNING to CANCELING. > 10 Jan 2019 20:36:51,628 INFO org.apache.flink.runtime.taskmanager.Task - > Triggering cancellation of task code interactions-count (1/1) > (aff734ce398978cdc3ac40a1e530d0ed). > 10 Jan 2019 20:36:51,680 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task agents-working-on-interactions (1/1) > (15aa5e81a66a46127ab85719b9df7279). > 10 Jan 2019 20:36:51,680 INFO org.apache.flink.runtime.taskmanager.Task - > agents-working-on-interactions (1/1) (15aa5e81a66a46127ab85719b9df7279) > switched from RUNNING to CANCELING. > 10 Jan 2019 20:36:51,680 INFO org.apache.flink.runtime.taskmanager.Task - > Triggering cancellation of task code agents-working-on-interactions (1/1) > (15aa5e81a66a46127ab85719b9df7279). > 10 Jan 2019 20:36:51,811 ERROR > org.apache.flink.streaming.runtime.tasks.StreamTask - Could not shut down > timer service > java.lang.InterruptedException > at > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2067) > at > java.util.concurrent.ThreadPoolExecutor.awaitTermination(ThreadPoolExecutor.java:1475) > at > org.apache.flink.streaming.runtime.tasks.SystemProcessingTimeService.shutdownAndAwaitPending(SystemProcessingTimeService.java:197) > at > org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:317) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718) > at java.lang.Thread.run(Thread.java:748) > 10 Jan 2019 20:36:51,811 ERROR > org.apache.flink.streaming.runtime.tasks.StreamTask - Could not shut down > timer service > java.lang.InterruptedException > at > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2067) > at > java.util.concurrent.ThreadPoolExecutor.awaitTermination(ThreadPoolExecutor.java:1475) > at > org.apache.flink.streaming.runtime.tasks.SystemProcessingTimeService.shutdownAndAwaitPending(SystemProcessingTimeService.java:197) > at > org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:317) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:718) > at java.lang.Thread.run(Thread.java:748) > 10 Jan 2019 20:36:51,813 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task subscription-management (1/1) > (f5e529744e645e6acf00d2c5aab2006e). > 10 Jan 2019 20:37:07,156 INFO org.apache.flink.runtime.taskmanager.Task - > subscription-management (1/1) (f5e529744e645e6acf00d2c5aab2006e) switched > from RUNNING to CANCELING. > 10 Jan 2019 20:37:07,157 INFO org.apache.flink.runtime.taskmanager.Task - > Triggering cancellation of task code subscription-management (1/1) > (f5e529744e645e6acf00d2c5aab2006e). > 10 Jan 2019 20:37:07,164 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task filter-business-metrics -> Sink: data_feed (1/1) > (6c229624ea4735215fe98f5458c58c8e). > 10 Jan 2019 20:37:07,164 INFO org.apache.flink.runtime.taskmanager.Task - > filter-business-metrics -> Sink: data_feed (1/1) > (6c229624ea4735215fe98f5458c58c8e) switched from RUNNING to CANCELING. > 10 Jan 2019 20:37:07,164 INFO org.apache.flink.runtime.taskmanager.Task - > Triggering cancellation of task code filter-business-metrics -> Sink: > data_feed (1/1) (6c229624ea4735215fe98f5458c58c8e). > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task interaction-details (1/1) > (dc946a863e34f66a95df3a8e8d540cab). > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Task interaction-details (1/1) is already in state CANCELING > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task current-longests (1/1) > (2f1cee63ab479a8e9e492c990311ccc1). > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Task current-longests (1/1) is already in state CANCELING > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task interactions-count (1/1) > (aff734ce398978cdc3ac40a1e530d0ed). > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Task interactions-count (1/1) is already in state CANCELING > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task agents-working-on-interactions (1/1) > (15aa5e81a66a46127ab85719b9df7279). > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Task agents-working-on-interactions (1/1) is already in state CANCELING > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task subscription-management (1/1) > (f5e529744e645e6acf00d2c5aab2006e). > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Task subscription-management (1/1) is already in state CANCELING > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Attempting to cancel task filter-business-metrics -> Sink: data_feed (1/1) > (6c229624ea4735215fe98f5458c58c8e). > 10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - > Task filter-business-metrics -> Sink: data_feed (1/1) is already in state > CANCELING > > > > > > Regards, > Mahantesh Patil. > --0000000000008016140581f12d01 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Team,

Following up to check if any of you have faced this issue.=C2= =A0 If so how to resolve this.

Regards,
Mahantesh Patil.

On Mon, Feb 11, 2019 at 3:50 PM Maha= ntesh Patil <mahantesh.np@gmai= l.com> wrote:
Hi= Team,

We have Flink jobs running in cluster mode. When I cancel the jo= b and check for status it still shows as running.

Below is logs generate= d.=C2=A0 I do not see any useful information. Could you guys point me in a = right direction to debug this , our flink jobs do heavy processing , my und= erstanding is on cancelling flink waits till operator completes processing = to store save point. So is it happening because one of the operator is hung= waiting for resource and is there a way to configure timeout.


Appre= ciate your help.



10 Jan 2019 20:36:51,490 INFO org.apache= .flink.runtime.taskmanager.Task - Triggering cancellation of task code Sour= ce: control -> control-filter (1/1) (c6f50328bb09ce1ad389e5ea614fc8a9).<= /span>
10 Jan 2019 20:36:51,490 INFO org.apache.flink.runtime.t= askmanager.Task - Attempting to cancel task interaction-details (1/1) (dc94= 6a863e34f66a95df3a8e8d540cab).
10 Jan 2019 20:36:51,490 = INFO org.apache.flink.runtime.taskmanager.Task - interaction-details (1/1) = (dc946a863e34f66a95df3a8e8d540cab) switched from RUNNING to CANCELING.
10 Jan 2019 20:36:51,491 INFO org.apache.flink.runtime.taskm= anager.Task - Triggering cancellation of task code interaction-details (1/1= ) (dc946a863e34f66a95df3a8e8d540cab).
10 Jan 2019 20:36:= 51,491 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cance= l task current-longests (1/1) (2f1cee63ab479a8e9e492c990311ccc1).
10 Jan 2019 20:36:51,491 INFO org.apache.flink.runtime.taskmanage= r.Task - current-longests (1/1) (2f1cee63ab479a8e9e492c990311ccc1) switched= from RUNNING to CANCELING.
10 Jan 2019 20:36:51,491 IN= FO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of t= ask code current-longests (1/1) (2f1cee63ab479a8e9e492c990311ccc1).<= /div>
10 Jan 2019 20:36:51,492 INFO org.apache.flink.runtime.taskmana= ger.Task - Attempting to cancel task interactions-count (1/1) (aff734ce3989= 78cdc3ac40a1e530d0ed).
10 Jan 2019 20:36:51,492 INFO org= .apache.flink.runtime.taskmanager.Task - interactions-count (1/1) (aff734ce= 398978cdc3ac40a1e530d0ed) switched from RUNNING to CANCELING.
<= div style=3D"margin:0px;font-stretch:normal;font-size:11px;line-height:norm= al;font-family:Menlo">10 Jan 2019 20:36:51,628 INFO org.apache.flink.runtime.taskmanager.Ta= sk - Triggering cancellation of task code interactions-count (1/1) (aff734c= e398978cdc3ac40a1e530d0ed).
10 Jan 2019 20:36:51,680 IN= FO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task ag= ents-working-on-interactions (1/1) (15aa5e81a66a46127ab85719b9df7279).
10 Jan 2019 20:36:51,680 INFO org.apache.flink.runtime.taskm= anager.Task - agents-working-on-interactions (1/1) (15aa5e81a66a46127ab8571= 9b9df7279) switched from RUNNING to CANCELING.
10 Jan 20= 19 20:36:51,680 INFO org.apache.flink.runtime.taskmanager.Task - Triggering= cancellation of task code agents-working-on-interactions (1/1) (15aa5e81a6= 6a46127ab85719b9df7279).
10 Jan 2019 20:36:51,811 ERROR = org.apache.flink.streaming.runtime.tasks.StreamTask - Could not shut down t= imer service
java.lang.InterruptedException
=
=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0at java.ut= il.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(A= bstractQueuedSynchronizer.java:2067)
=C2=A0 =C2=A0 =C2= =A0 =C2=A0=C2=A0at java.util.concurrent.ThreadPool= Executor.awaitTermination(ThreadPoolExecutor.java:1475)
= =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0at org.apache.fli= nk.streaming.runtime.tasks.SystemProcessingTimeService.shutdownAndAwaitPend= ing(SystemProcessingTimeService.java:197)
=C2=A0 =C2=A0 = =C2=A0 =C2=A0=C2=A0at org.apache.flink.streaming.r= untime.tasks.StreamTask.invoke(StreamTask.java:317)
=C2= =A0 =C2=A0 =C2=A0 =C2=A0=C2=A0at org.apache.flink.= runtime.taskmanager.Task.run(Task.java:718)
=C2=A0 =C2= =A0 =C2=A0 =C2=A0=C2=A0at java.lang.Thread.run(Thr= ead.java:748)
10 Jan 2019 20:36:51,811 ERROR org.apache.= flink.streaming.runtime.tasks.StreamTask - Could not shut down timer servic= e
java.lang.InterruptedException
=C2= =A0 =C2=A0 =C2=A0 =C2=A0=C2=A0at java.util.concurr= ent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQue= uedSynchronizer.java:2067)
=C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0at java.util.concurrent.ThreadPoolExecutor.a= waitTermination(ThreadPoolExecutor.java:1475)
=C2=A0 =C2= =A0 =C2=A0 =C2=A0=C2=A0at org.apache.flink.streami= ng.runtime.tasks.SystemProcessingTimeService.shutdownAndAwaitPending(System= ProcessingTimeService.java:197)
=C2=A0 =C2=A0 =C2=A0 =C2= =A0=C2=A0at org.apache.flink.streaming.runtime.tas= ks.StreamTask.invoke(StreamTask.java:317)
=C2=A0 =C2=A0 = =C2=A0 =C2=A0=C2=A0at org.apache.flink.runtime.tas= kmanager.Task.run(Task.java:718)
=C2=A0 =C2=A0 =C2=A0 = =C2=A0=C2=A0at java.lang.Thread.run(Thread.java:74= 8)
10 Jan 2019 20:36:51,813 INFO org.apache.flink.runtim= e.taskmanager.Task - Attempting to cancel task subscription-management (1/1= ) (f5e529744e645e6acf00d2c5aab2006e).
10 Jan 2019 20:37:= 07,156 INFO org.apache.flink.runtime.taskmanager.Task - subscription-manage= ment (1/1) (f5e529744e645e6acf00d2c5aab2006e) switched from RUNNING to CANC= ELING.
10 Jan 2019 20:37:07,157 INFO org.apache.flink.ru= ntime.taskmanager.Task - Triggering cancellation of task code subscription-= management (1/1) (f5e529744e645e6acf00d2c5aab2006e).
10 = Jan 2019 20:37:07,164 INFO org.apache.flink.runtime.taskmanager.Task - Atte= mpting to cancel task filter-business-metrics -> Sink: data_feed (1/1) (= 6c229624ea4735215fe98f5458c58c8e).
10 Jan 2019 20:37:07,= 164 INFO org.apache.flink.runtime.taskmanager.Task - filter-business-metric= s -> Sink: data_feed (1/1) (6c229624ea4735215fe98f5458c58c8e) switched f= rom RUNNING to CANCELING.
10 Jan 2019 20:37:07,164 INFO = org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task= code filter-business-metrics -> Sink: data_feed (1/1) (6c229624ea473521= 5fe98f5458c58c8e).
10 Jan 2019 20:37:07,182 INFO org.apa= che.flink.runtime.taskmanager.Task - Attempting to cancel task interaction-= details (1/1) (dc946a863e34f66a95df3a8e8d540cab).
10 Jan= 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - Task in= teraction-details (1/1) is already in state CANCELING
10= Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - Att= empting to cancel task current-longests (1/1) (2f1cee63ab479a8e9e492c990311= ccc1).
10 Jan 2019 20:37:07,182 INFO org.apache.flink.ru= ntime.taskmanager.Task - Task current-longests (1/1) is already in state CA= NCELING
10 Jan 2019 20:37:07,182 INFO org.apache.flink.r= untime.taskmanager.Task - Attempting to cancel task interactions-count (1/1= ) (aff734ce398978cdc3ac40a1e530d0ed).
10 Jan 2019 20:37:= 07,182 INFO org.apache.flink.runtime.taskmanager.Task - Task interactions-c= ount (1/1) is already in state CANCELING
10 Jan 2019 20:= 37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to ca= ncel task agents-working-on-interactions (1/1) (15aa5e81a66a46127ab85719b9d= f7279).
10 Jan 2019 20:37:07,182 INFO org.apache.flink.r= untime.taskmanager.Task - Task agents-working-on-interactions (1/1) is alre= ady in state CANCELING
10 Jan 2019 20:37:07,182 INFO org= .apache.flink.runtime.taskmanager.Task - Attempting to cancel task subscrip= tion-management (1/1) (f5e529744e645e6acf00d2c5aab2006e).
10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task -= Task subscription-management (1/1) is already in state CANCELING
10 Jan 2019 20:37:07,182 INFO org.apache.flink.runtime.taskmanage= r.Task - Attempting to cancel task filter-business-metrics -> Sink: data= _feed (1/1) (6c229624ea4735215fe98f5458c58c8e).
10 Jan 2= 019 20:37:07,182 INFO org.apache.flink.runtime.taskmanager.Task - Task filt= er-business-metrics -> Sink: data_feed (1/1) is already in state CANCELI= NG




=
Regards,
Mahan= tesh Patil.
--0000000000008016140581f12d01--