From user-return-26631-archive-asf-public=cust-asf.ponee.io@flink.apache.org Wed Mar 20 16:00:05 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id B4E7318062C for ; Wed, 20 Mar 2019 17:00:04 +0100 (CET) Received: (qmail 63425 invoked by uid 500); 20 Mar 2019 16:00:03 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 63415 invoked by uid 99); 20 Mar 2019 16:00:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Mar 2019 16:00:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id D7029180AC9 for ; Wed, 20 Mar 2019 16:00:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.108 X-Spam-Level: *** X-Spam-Status: No, score=3.108 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, KAM_REALLYHUGEIMGSRC=1.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=dcbrain-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id esX8aMUf1oJC for ; Wed, 20 Mar 2019 15:59:59 +0000 (UTC) Received: from mail-vs1-f45.google.com (mail-vs1-f45.google.com [209.85.217.45]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 2D8145F188 for ; Wed, 20 Mar 2019 15:59:59 +0000 (UTC) Received: by mail-vs1-f45.google.com with SMTP id n4so1819518vsm.3 for ; Wed, 20 Mar 2019 08:59:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dcbrain-com.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=5B/J9S+Pg4U6TOl1fHXoWTVLOZrJltTujdLBo5HonmU=; b=HpuxFCMdd3hBsUqIzJGIHI7N/z1t8be3KHMVRLcEy5jYyx1bYiJVwkk70BB2nsE7lF SBN030UrlYzVPlpGeM++m9bG5an56aXu3IegmGDQLQSB8zDMmDmOy4IX704ejdozR63I fa+AR4GsLQSij77sI+A+oVwcvPP/0p2XVIUBcR/NTJf5gbrWUiZiQja/pYuDrwbZ28ak TBebBTtp80kuhXqdBwfRcu9wbYf8AiyWYgUzo8p7s6nPCYqasGjIwU3wrH+0ytojcm7S ZLeBTDYT1ioCbfdv6V7wL9WoyHmcHW58hJ70dZ9TsrIpa8ddQJISe/XOYlxLZmtA4Ied daYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=5B/J9S+Pg4U6TOl1fHXoWTVLOZrJltTujdLBo5HonmU=; b=cRJtRa3r29AuT+dFksM01DyQbDAG6ak1iklq0Xo0ibRjs/JxTiHZTVsFBq6XogRRd/ 4V9pweIIDgtCTFkTF9y25GajecJOYxHRhZjyQ0FoZjpNEmsgSRVT/fi4+rJewaAAb1ee zNpXOQ84+n3Ulty7kfD/MjETzig8jjWEkwAJj6Fgj/O50kD9RF4euO7rwuW56dRAE1wp dDpUIrm4TmIRaYngnKZxpfDwMLi++RiYhjMCXMv+lkCkld1t6Pni2ccn+SR8CWgiVnBN fTmkmuOrApsRYPpws1Yq/mEeykgs86A8Mwid16YnZewoJk6lJyzgIriqew5irgQ6Bffb veBw== X-Gm-Message-State: APjAAAUEDwRsdemabI7+S6W719oqTmevsltlT5n+mIanmTQ8mntwhNq3 Uoi0oU4Xbh6d/vVOu2rnUcVNfpmnp67iaKV5tIaWWQRofsuEIlw9NAkKwP0hoVGQdOBwDG+o2eF cue9gLp1mkBm9KJloAzIpO6qGuUuwRQ== X-Google-Smtp-Source: APXvYqy8flkM9RoRQt0zn4kThtCqXaCh6KMRhjtl5hb6rJY7enQKO1UfWXmL12P1gACDw0+VnWkFqcOdCQ6IGard+ew= X-Received: by 2002:a67:8210:: with SMTP id e16mr5161395vsd.85.1553097597843; Wed, 20 Mar 2019 08:59:57 -0700 (PDT) MIME-Version: 1.0 From: anissa moussaoui Date: Wed, 20 Mar 2019 16:59:47 +0100 Message-ID: Subject: state and Id of job in flatMap To: user@flink.apache.org Content-Type: multipart/alternative; boundary="0000000000009f2398058488b6b2" --0000000000009f2398058488b6b2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello, I created a process for an anomaly detection with a flatMap. I need to know the end of each job at the level of the flatMap to be able to flush a buffer in the output collector. I saw that it is possible to get status of job by using ExecutionEnvironmen= t, but i don't know how i can implement it. Is it possible to recover the end of each job in the flatMap of any processing source with last iteration of job or to have in advance the size of the partition that each job must deal ? Thank's in advance ! Anissa --=20 =C2=A0=C2=A0 =C2=A0=C2=A0=20 =C2=A0=C2=A0=20 =C2=A0Pensez =C3=A0 la=20 plan=C3=A8te, imprimer ce papier que si n=C3=A9cessaire=C2=A0 --0000000000009f2398058488b6b2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

Hello,

I created a process for an anom= aly detection with a flatMap. I need to know the end of each job at the level of the flatMap to be able to flush a buffer in the output collect= or.

I saw that it is possible to get status of job by using=C2=A0<= /span>ExecutionEnvi= ronment, but i don't know how i can implement it.

Is it po= ssible to recover the end of each job in the flatMap of any processing sour= ce with last iteration of job or to have in advance the size of the partiti= on that each job must deal ?

Thank's in advance !

Anissa




<= /a>=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0= =C2=A0

3D"Arbre=C2=A0Pensez =C3=A0 la plan=C3=A8te,= imprimer ce papier que si n=C3=A9cessaire=C2=A0 --0000000000009f2398058488b6b2--