From user-return-19188-archive-asf-public=cust-asf.ponee.io@flink.apache.org Thu Apr 5 00:06:06 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 7AE1518064F for ; Thu, 5 Apr 2018 00:06:05 +0200 (CEST) Received: (qmail 55380 invoked by uid 500); 4 Apr 2018 22:05:59 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 55366 invoked by uid 99); 4 Apr 2018 22:05:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Apr 2018 22:05:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 4B4DB1A1163 for ; Wed, 4 Apr 2018 22:05:58 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.211 X-Spam-Level: *** X-Spam-Status: No, score=3.211 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id h3QnSMmRAuTp for ; Wed, 4 Apr 2018 22:05:57 +0000 (UTC) Received: from mail-wr0-f182.google.com (mail-wr0-f182.google.com [209.85.128.182]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 907315F180 for ; Wed, 4 Apr 2018 22:05:56 +0000 (UTC) Received: by mail-wr0-f182.google.com with SMTP id z73so25139035wrb.0 for ; Wed, 04 Apr 2018 15:05:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=ksQlBoKDTZHu8G3FvCJli5Kw7H2rJgtC4hicJLpZbI0=; b=XmgVGwkve53ipcgQb9chCY0b6fLBNw5IYIRo8UJdjS/kszm+1whx4w12ngD4wKm+rz HNNviqUMisTJLZSXsoRJcqAn12hLubh/WPCRLWtklhMBMZ+rZASN82M1O65d0bcCRwKj Ru1VzlI75hDbiGikDbPAJ9vTVt2ifFX+hYfLna/+kge/Wzaw/9rNsDjfQZ3enkb/HH3U QFwaKoSYNxtLmhLcdJw7c7Bu4K/LYKeThEe4RHttymu3IXL+z5vDnd2m9Q++Omyjtc+j B5zWnkCK1EyKLm0hgGt41zZThQHDBj7cOEf5JFkj1IzkagxrAlZ8KOUyRyJVi+iHniIb TBSQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=ksQlBoKDTZHu8G3FvCJli5Kw7H2rJgtC4hicJLpZbI0=; b=jSSzU6DHopAvj95MKzVNjP1AwpSCpTkk6d2qqUJ+P/Bu/s/GGWAmMc88kw0yr0K2od Cd+/lMOZrsgEuuqaXIfswFJCkOY86qsY3SYdIctwrxARBYYh1SXhKdvWkuqJ89Q6nWYo Q2IJ7+CoIzGxOEXNXyXkbpFX4MgOu9ulp8C7xu4nQYhP7D1H4P64orOirFNQT6zoY/ah oI2PLVaU2qfcJFZvO/p5kfm6UMMTXfMGlYifyrvcONIn6GWEIafTPyzqWwlDIPFkN6Un 2ODvEWWxJg3qcROZUf0D3F9Bn0KIc8Vc+PMR+mMtvaloQmghorf9JhfeDYubr3Hi2f/Y PmKw== X-Gm-Message-State: ALQs6tA8TnmnmMYsJ8tqtEVKuSOZS4HiFXXu7JW+UDEAPqnQe6BNvuBd I2szWbAwsunJu08TuezeZUpyuI3oIeZ6ggyF7HY= X-Google-Smtp-Source: AIpwx4+u9qvd1uOiPcpm9v1hfLVXhjg8gevJY0BhpxuUuY+NzwgUR1JHr+wT6BBH+hXNbjGS0EgDj3PU6ekyOAlSvfY= X-Received: by 2002:a19:c6c8:: with SMTP id w191-v6mr11757756lff.40.1522879556234; Wed, 04 Apr 2018 15:05:56 -0700 (PDT) MIME-Version: 1.0 Received: by 10.46.136.199 with HTTP; Wed, 4 Apr 2018 15:05:15 -0700 (PDT) In-Reply-To: <1522877177389-0.post@n4.nabble.com> References: <1522839803543-0.post@n4.nabble.com> <1522877177389-0.post@n4.nabble.com> From: Fabian Hueske Date: Thu, 5 Apr 2018 00:05:15 +0200 Message-ID: Subject: Re: Collect event which arrive after watermark To: shishal Cc: user Content-Type: multipart/alternative; boundary="000000000000fc35e505690d0648" --000000000000fc35e505690d0648 Content-Type: text/plain; charset="UTF-8" Window operators drop late events by default. When they receive a late event, they already computed and emitted a result. Since there is not good default behavior to hay ndle a late event in this case, they are simply dropped. However, Flink offers multiple ways to explicitly handle late events such as sending them to a side output or computing and emitting an updated result. So, if you apply a ProcessFunction before any other operator, you can handle all late events. Best, Fabian 2018-04-04 23:26 GMT+02:00 shishal : > Thanks Fabian, My understand was that late event older than watermark is > dropped. So processFunction wont be called for late event. So I guess my > understanding was wrong. Or there is something more to it? > > > > -- > Sent from: http://apache-flink-user-mailing-list-archive.2336050. > n4.nabble.com/ > --000000000000fc35e505690d0648 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Window operators drop late events by default. When th= ey receive a late event, they already computed and emitted a result.
Since there is not good default behavior to hay ndle a late event = in this case, they are simply dropped.
However, Flink offers = multiple ways to explicitly handle late events such as sending them to a si= de output or computing and emitting an updated result.

So= , if you apply a ProcessFunction before any other operator, you can handle = all late events.

Best, Fabian

2018-04-04 23:26 GMT+02:00 = shishal <shishal.a@gmail.com>:
Thanks Fabian, My understand was that late event older than watermar= k is
dropped. So processFunction wont be called for late event. So I guess my understanding was wrong. Or there is something more to it?



--
Sent from: http://apache-flink-u= ser-mailing-list-archive.2336050.n4.nabble.com/

--000000000000fc35e505690d0648--