nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [nifi] YolandaMDavis commented on issue #3854: NIFI-6819: Add KafkaRecordSink implementations for Kafka 1 and 2
Date Thu, 31 Oct 2019 15:13:14 GMT
YolandaMDavis commented on issue #3854: NIFI-6819: Add KafkaRecordSink implementations for
Kafka 1 and 2
URL: https://github.com/apache/nifi/pull/3854#issuecomment-548423670
 
 
   @mattyb149 Happened to run across an interesting error (which I think is unrelated to PR
and may be an knwon issue with Kafka api).  My test cluster was initially misconfigured where
I had a replication factor of 3 set for the test topic yet only had one broker configured.
 The Kafka Sink appeared to send data, according to debug, however Consume Kafka Record and
the command line consumer could not retrieve any messages.  Looking into the error log I saw
the issue, however I was surprised that this didn't appear in NiFi logs:
   
   This error can be ignored if the cluster is starting up and not all brokers are up yet.
   2019-10-31 14:16:45,149 ERROR kafka.server.KafkaApis: [KafkaApi-72] Number of alive brokers
'1' does not meet the required replication factor '3' for the offsets topic (configured via
'offsets.topic.replication.factor'). This error can be ignored if the cluster is starting
up and not all brokers are up yet.
   
   There is a JIRA I believe is related here: https://issues.apache.org/jira/browse/KAFKA-5666
but just want to confirm if this is a potential issue that can be ignored or documented?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message