From user-return-34024-archive-asf-public=cust-asf.ponee.io@flink.apache.org Thu Apr 9 17:53:12 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id CB09A180634 for ; Thu, 9 Apr 2020 19:53:11 +0200 (CEST) Received: (qmail 41850 invoked by uid 500); 9 Apr 2020 17:53:10 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 41840 invoked by uid 99); 9 Apr 2020 17:53:10 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Apr 2020 17:53:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 9054BC229B for ; Thu, 9 Apr 2020 17:53:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id s9Xu8iLKfTvG for ; Thu, 9 Apr 2020 17:53:07 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::844; helo=mail-qt1-x844.google.com; envelope-from=yuvalos@gmail.com; receiver= Received: from mail-qt1-x844.google.com (mail-qt1-x844.google.com [IPv6:2607:f8b0:4864:20::844]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id D55FB7FA88 for ; Thu, 9 Apr 2020 17:53:06 +0000 (UTC) Received: by mail-qt1-x844.google.com with SMTP id x2so667511qtr.0 for ; Thu, 09 Apr 2020 10:53:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=WW3JheZ8Y3I3kTNJ1hRGZeXOP0+ldRO7Jlo3amFtjlg=; b=sW9AwjnfmfMs87mtmu7fDrU7qtZg9ufeD379KfY6Mv7+RFZ3BmozqcZXWQfMYIrK5H cIOS4b5Bxxxrvo8FA8WN3R5aGI8G16eOb793PY0dcwEj3sSYJFmTpIecEy3pVWX0YS81 u9GDo9we3Sign0FrfZyYvLgCjqkg4sgRH4kD7Ni0forzInOmYdqPD/ec8g3N5cJSX57v 6gnuwoPRHJ3AJ4Eu4z11R1ACLT2P8ePd5tAK5W9vRU0U1tuFS+FCUY/Diqkl8WobR7op ZbwOvKk/O1U2g6zAzJU0Aoq+oJho3P35ZxQzijZeGLizzK7IoCPFIfVtFd9jbqKONiPT 2u8Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=WW3JheZ8Y3I3kTNJ1hRGZeXOP0+ldRO7Jlo3amFtjlg=; b=LkoIw7X3A1cys2YTk6Bom8+VhF4mK7c0RT1RUDRuAkojm7/aON4TrEJ4WrPYW6ucbH gMTuuD6Eje9lCDNY6ZzxBUVa9hyUUchDUpm7qqn8Pgg0xkdPyp7FNWHj7mO1n4Hq5C9e jjqnPW4aHuSTNuGUzUFJJaxjHo+xwQPLBtPRjLVoqugQiY/fx/ES1bbGabS86bLRF0Ia SSB8Xt3DDsFcGNbI+7b0DxoWHmfw8ThXqcGAP72AWEBitoIjAqnmeS4kQNH6/ZwrpSX2 qOVr0lJuM86MoxVR6R+HMo9rgfg+kQGad9SjhLOu/X0ie0k16afO7B4MheWeS7oS/bm/ iiXA== X-Gm-Message-State: AGi0PuaFRMaaWAeMm9Y5Z1BfxWi+E0KUeI0Hg8MT0RegW00w5eI+HM2f OvNJ5EUyaPlfDx6POzHIgRVw4qZXdkONorSKP0F9ekonizc= X-Google-Smtp-Source: APiQypIYSlBI7NscEyaQ+g2Zqe/Sj9OFNjCrASgau4UVgfZzCXK2VUhF3eC1GaCfyf4uAOE86KTfQfOfH/CRHBqQaJE= X-Received: by 2002:ac8:138c:: with SMTP id h12mr546186qtj.210.1586454785356; Thu, 09 Apr 2020 10:53:05 -0700 (PDT) MIME-Version: 1.0 From: Yuval Itzchakov Date: Thu, 9 Apr 2020 20:52:54 +0300 Message-ID: Subject: Passing checkpoint lock object to StreamSourceContexts.getSourceContext after StreamTask.getCheckpointLock deprecation To: user Content-Type: multipart/alternative; boundary="000000000000ef05d905a2df4986" --000000000000ef05d905a2df4986 Content-Type: text/plain; charset="UTF-8" Hi, I have an implementation of a custom source, which uses StreamSourceContexts.getSourceContext ( https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/StreamSourceContexts.java#L46) which has a checkpointLock argument that's used for watermark emission and possibly additional work. Flink 1.10 marks StreamTask.getCheckpointLock as deprecated and points to using YieldingOperatorFactory instead. Question is, with the above method now being deprecated, which object should we pass to getSourceContext for the required checkpointLock? -- Best Regards, Yuval Itzchakov. --000000000000ef05d905a2df4986 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi,

I have an implementation of a custo= m source, which uses StreamSourceContexts.getSourceContext (htt= ps://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java= /org/apache/flink/streaming/api/operators/StreamSourceContexts.java#L46= ) which has a checkpointLock argument that's used for watermark emissio= n=C2=A0and possibly additional work.

Flink 1.10 ma= rks StreamTask.getCheckpointLock as deprecated and points to using Yielding= OperatorFactory instead.

Question is, with the abo= ve method now being deprecated, which object should we pass to getSourceCon= text for the required checkpointLock?

--
Best Regards,
Yuval Itzchakov.
--000000000000ef05d905a2df4986--