Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 56156200C87 for ; Wed, 17 May 2017 19:35:41 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5493F160BBA; Wed, 17 May 2017 17:35:41 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 9AE8C160BAC for ; Wed, 17 May 2017 19:35:40 +0200 (CEST) Received: (qmail 86865 invoked by uid 500); 17 May 2017 17:35:34 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 86855 invoked by uid 99); 17 May 2017 17:35:34 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 May 2017 17:35:34 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 379B61803A3 for ; Wed, 17 May 2017 17:35:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 4.314 X-Spam-Level: **** X-Spam-Status: No, score=4.314 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, KAM_LAZY_DOMAIN_SECURITY=1, URIBL_BLOCKED=0.001, URI_HEX=1.313] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 5A1ZBMF41EY9 for ; Wed, 17 May 2017 17:35:30 +0000 (UTC) Received: from v35509.1blu.de (v35509.1blu.de [178.254.33.207]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id DEEDE5F568 for ; Wed, 17 May 2017 17:35:29 +0000 (UTC) Received: (qmail 6447 invoked from network); 17 May 2017 19:35:22 +0200 Received: from p549cdb5a.dip0.t-ipconnect.de (HELO alicante.fritz.box) (84.156.219.90) by v35509.1blu.de with ESMTPSA (DHE-RSA-AES256-GCM-SHA384 encrypted, authenticated); 17 May 2017 19:35:22 +0200 From: Valentin Content-Type: multipart/alternative; boundary="Apple-Mail=_B08EF9D1-B8D1-4B76-8D79-21293625A63B" Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: FlinkKafkaConsumer using Kafka-GroupID? Date: Wed, 17 May 2017 19:35:20 +0200 References: <1494950622907-13170.post@n4.nabble.com> <97B3D27B-C34E-45B9-BB6B-69320C8EE973@data-artisans.com> To: user@flink.apache.org In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3273) archived-at: Wed, 17 May 2017 17:35:41 -0000 --Apple-Mail=_B08EF9D1-B8D1-4B76-8D79-21293625A63B Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi there, As far as I understood, Flink Kafka Connectors don=E2=80=99t use the = consumer group management feature from Kafka. Here the post I got the = info from: = http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-= kafka-group-question-td8185.html#none = For some reasons we cannot set up a flink-cluster environment, but we = still need to assure high availability. e.g. in case one node goes down = the second should still keep on running. My question: - Is there any chance to run 2 different flink (standalone) apps = consuming messages from a single kafka-topic only once? This is what I = could do by using 2 native Kafka-Consumers within the same = consumer-group. Many thanks in advance Valentin=20 =20= --Apple-Mail=_B08EF9D1-B8D1-4B76-8D79-21293625A63B Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 Hi there,

As far as I understood, Flink Kafka Connectors don=E2=80=99t = use the consumer group management feature from Kafka. Here the post I = got the info from:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble= .com/Flink-kafka-group-question-td8185.html#none

For some reasons we = cannot set up a flink-cluster environment, but we still need to assure = high availability. e.g. in case one node goes down the second should = still keep on running.


My question:
- Is there any chance to run 2 different flink (standalone) = apps consuming messages from a single kafka-topic only once? This is = what I could do by using 2 native Kafka-Consumers within the same = consumer-group.

Many thanks in advance
Valentin 
 
= --Apple-Mail=_B08EF9D1-B8D1-4B76-8D79-21293625A63B--