Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B2389200C80 for ; Thu, 25 May 2017 18:51:23 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B0D64160BCA; Thu, 25 May 2017 16:51:23 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 03603160BB4 for ; Thu, 25 May 2017 18:51:22 +0200 (CEST) Received: (qmail 4768 invoked by uid 500); 25 May 2017 16:51:22 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 4757 invoked by uid 99); 25 May 2017 16:51:22 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 May 2017 16:51:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 9E1A7C0096 for ; Thu, 25 May 2017 16:51:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id mG2_pSkcMdsk for ; Thu, 25 May 2017 16:51:19 +0000 (UTC) Received: from mail-yw0-f174.google.com (mail-yw0-f174.google.com [209.85.161.174]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 4EFF05FD7D for ; Thu, 25 May 2017 16:51:19 +0000 (UTC) Received: by mail-yw0-f174.google.com with SMTP id p73so94936594ywp.0 for ; Thu, 25 May 2017 09:51:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=HMB43xRinEbIhGJ/C7pJNY2PIRqvzG/jmntPpfVc5Z0=; b=UzGqI+NcQ5pOjRkYMuRi5bSe6aTWvtUQLnuZxDKNtgC1G1dB4dcP2+86uRmJNck1C5 HCv+LALDsJTS4ruF/ie/lVRD071BE6KtyEeTphkokisyiG8TVp8VGQt+ZT+Ywm7E78pC OXqXHB8iTy1kyGjETohThBjEbxzOAvD2ahOJExlKS6XDXxyGG+nnRBmzcLu6ykFN8BbO CUq2rh9k7PLmqeXl6ysuRCvH29wdBOJ+zIC+D/bBfMNfktO9UGDwXMtukCDX79thlBcE 5OwmpQW45xIYDTT5Y+99YIhB8/uMDw0glHuhjU76EOSFMtMJnxjJphGGVAs120OnPaE7 CeEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=HMB43xRinEbIhGJ/C7pJNY2PIRqvzG/jmntPpfVc5Z0=; b=SxfS9XrtXd/DUkboS3ieK3egLm+jOOzOf58dSV2S6octVPvgOXi5Q4TEeYVomnsKzn nrZmMwOvPw6mu800pYX/JB8uTlPhDS6AybOPDgAtB/kwxAFvO2TkrGRS/T5T4lkTERQZ csFhL+nM1OrMpuol754coB/bhbC+cLkNUoDi60rcRFPxr/8YHK3mCOOZu7FXe/stjxQ5 mnhKCZkn1ozzUefHWQ8Ja/VfMrlwU5kfUn4JqQoppQahOq+R5P7FC5lmiwQXD6IN8R3H XNH3FZeTSg2J6QRqCK4a8jbTAENFKBaGRIcx/cH+PyJ4wIoCs/RdJLFYfRKrU8qZUJuB oWYA== X-Gm-Message-State: AODbwcDJIZ27LCVSAbNACah5vbnmDJqvJHCD+brK7CeqVe4AKeBoWoGc ea5SATbJNqBlpSQT8xY8bpeQGev47w== X-Received: by 10.129.27.2 with SMTP id b2mr34235716ywb.334.1495731078973; Thu, 25 May 2017 09:51:18 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.199.199 with HTTP; Thu, 25 May 2017 09:50:58 -0700 (PDT) In-Reply-To: References: From: Moiz S Jinia Date: Thu, 25 May 2017 22:20:58 +0530 Message-ID: Subject: Re: Are timers in ProcessFunction fault tolerant? To: Eron Wright Cc: user@flink.apache.org Content-Type: multipart/alternative; boundary="001a11429a50a454b405505c074d" archived-at: Thu, 25 May 2017 16:51:23 -0000 --001a11429a50a454b405505c074d Content-Type: text/plain; charset="UTF-8" Awesome. Thanks. On Thu, May 25, 2017 at 10:13 PM, Eron Wright wrote: > Yes, registered timers are stored in managed keyed state and should be > fault-tolerant. > > -Eron > > On Thu, May 25, 2017 at 9:28 AM, Moiz S Jinia > wrote: > >> With a checkpointed RocksDB based state backend, can I expect the >> registered processing timers to be fault tolerant? (along with the managed >> keyed state). >> >> Example - >> A task manager instance owns the key k1 (from a keyed stream) that has >> registered a processing timer with a timestamp thats a day ahead in the >> future. If this instance is killed, and the key is moved to another >> instance, will the onTimer trigger correctly on the other machine at the >> expected time with the same keyed state (for k1)? >> >> Thanks, >> Moiz >> > > --001a11429a50a454b405505c074d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Awesome. Thanks.

On Thu, May 25, 2017 at 10:13 PM, Eron Wright <er= onwright@gmail.com> wrote:
=
Yes, registered timers are stored in managed keyed state a= nd should be fault-tolerant.=C2=A0

-Eron

On Thu, May 25, 2017 at 9:28 AM, Moiz S Jinia &l= t;moiz.jinia@gmai= l.com> wrote:
With a checkpointed RocksDB based state backend, can I expect the regis= tered processing timers to be fault tolerant? (along with the managed keyed= state).

Example -
A task manager instance own= s the key k1 (from a keyed stream) that has registered a processing timer w= ith a timestamp thats a day ahead in the future. If this instance is killed= , and the key is moved to another instance, will the onTimer trigger correc= tly on the other machine at the expected time with the same keyed state (fo= r k1)?

Thanks,
Moiz


--001a11429a50a454b405505c074d--