Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 161AE200D50 for ; Mon, 4 Dec 2017 12:36:45 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 146D3160C05; Mon, 4 Dec 2017 11:36:45 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 34732160BF9 for ; Mon, 4 Dec 2017 12:36:44 +0100 (CET) Received: (qmail 7733 invoked by uid 500); 4 Dec 2017 11:36:43 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 7715 invoked by uid 99); 4 Dec 2017 11:36:43 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Dec 2017 11:36:43 +0000 Received: from Tzu-Lis-MBP.mail (host-58-114-155-116.dynamic.kbtelecom.net [58.114.155.116]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id A2A1D1A0158; Mon, 4 Dec 2017 11:36:41 +0000 (UTC) Date: Mon, 4 Dec 2017 19:36:38 +0800 From: "Tzu-Li (Gordon) Tai" To: Soheil Pourbafrani , user@flink.apache.org Cc: Aljoscha Krettek Message-ID: In-Reply-To: References: Subject: Re: using regular expression to specify Kafka topics X-Mailer: Airmail (457) MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="5a253346_7839c4a1_243" archived-at: Mon, 04 Dec 2017 11:36:45 -0000 --5a253346_7839c4a1_243 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Hi, I=E2=80=99ve created a PR to publicly expose the feature:=C2=A0https://gi= thub.com/apache/flink/pull/5117. Whether or not we should include this in the next release candidate for 1= .4 is still up for discussion. Best, Gordon On 4 December 2017 at 3:02:29 PM, Tzu-Li (Gordon) Tai (tzulitai=40apache.= org) wrote: Hi Soheil, That feature is actually already internally available. The only issue is that the functionality is not yet exposed via any publi= c APIs on the Kafka consumer. Please see this JIRA here:=C2=A0https://issues.apache.org/jira/browse/=46= LINK-8190. I=E2=80=99m not sure of exposing the pattern-based subscription API now f= or 1.4, though. Although it is only a matter of exposing already implemented features, A=46= AIK pattern-based subscription is not thoroughly tested in the release ca= ndidates. cc =40Aljoscha, what do you think about this=3F Best, Gordon On 3 December 2017 at 5:29:32 AM, Soheil Pourbafrani (soheil.ir08=40gmail= .com) wrote: I use =46link Kafka=C2=A0connector 10 to subscribe topics and get data. N= ow I want to specify topics not using String, but regular expression. I w= ant to do that just because it can recognize future topics added to the K= afka and get their data. Spark Kafka connector has a method named SubscribePattern and we can use = it to subscribe to topics using regular expressions. Is there something equivalent=C2=A0or some other way to do that=3F --5a253346_7839c4a1_243 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline