Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1428620049C for ; Fri, 11 Aug 2017 13:00:29 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0C4F416D157; Fri, 11 Aug 2017 11:00:29 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 51B2216D153 for ; Fri, 11 Aug 2017 13:00:28 +0200 (CEST) Received: (qmail 2968 invoked by uid 500); 11 Aug 2017 11:00:27 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 2958 invoked by uid 99); 11 Aug 2017 11:00:27 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Aug 2017 11:00:27 +0000 Received: from Tzu-Lis-MBP.mail (114-36-112-222.dynamic-ip.hinet.net [114.36.112.222]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 15D6D1A04B8; Fri, 11 Aug 2017 11:00:25 +0000 (UTC) Date: Fri, 11 Aug 2017 19:00:22 +0800 From: "Tzu-Li (Gordon) Tai" To: AndreaKinn , user@flink.apache.org Message-ID: In-Reply-To: <1502448142716-14822.post@n4.nabble.com> References: <1502448142716-14822.post@n4.nabble.com> Subject: Re: Error during Kafka connection X-Mailer: Airmail (442) MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="598d8e47_4c03e00e_120" archived-at: Fri, 11 Aug 2017 11:00:29 -0000 --598d8e47_4c03e00e_120 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, AFAIK, Kafka group coordinators are supposed to always be marked dead, because we use static assignment internally and therefore Kafka's group coordination functionality is disabled. Though it may be obvious, but to get that out of the way first: are you sure that the Kafka installation version matches (i.e. 0.10.0.1)? Cheers, Gordon On 11 August 2017 at 6:43:51 PM, AndreaKinn (kinn6aer@hotmail.it) wrote: Hi, In the last week I have correctly deployed a flink program which get data from a kafka broker on my local machine. Now I'm trying to produce the same thing but moving the kafka broker on a cluster. I didn't change any line of code, I report it here: DataStream> stream = env .addSource(new FlinkKafkaConsumer010<>(TOPIC, new CustomDeserializer(), properties)) .assignTimestampsAndWatermarks(new CustomTimestampExtractor()) .keyBy(0); While I have changed just the Kafka Ip. Data model obviously is not changed. Unfortunately now when I start Flink program I get this: INFO org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.0.1 12:30:48,446 INFO org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : a7a17cdec9eaa6c5 12:30:48,625 INFO org.apache.kafka.clients.consumer.internals.AbstractCoordinator - Discovered coordinator giordano-1-4-200:9092 (id: 2147483647 rack: null) for group groupId. 12:30:48,626 INFO org.apache.kafka.clients.consumer.internals.AbstractCoordinator - *Marking the coordinator giordano-1-4-200:9092 (id: 2147483647 rack: null) dead for group groupId* I bolded the line that worry me. Then, no data are retrieved buy Kafka although flink continue to perform checkpointing etc normally... Any ideas? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Error-during-Kafka-connection-tp14822.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com. --598d8e47_4c03e00e_120 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline