flume-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bimalendu Choudhary (Jira)" <j...@apache.org>
Subject [jira] [Created] (FLUME-3346) kafka channel tries to spin producer even when configured without any source
Date Wed, 23 Oct 2019 17:45:00 GMT
Bimalendu Choudhary created FLUME-3346:
------------------------------------------

             Summary: kafka channel tries to spin producer even when configured without any
source
                 Key: FLUME-3346
                 URL: https://issues.apache.org/jira/browse/FLUME-3346
             Project: Flume
          Issue Type: Bug
          Components: Kafka Channel
            Reporter: Bimalendu Choudhary


When we configure kafka channel without any source we expect that the channel will only start
consumer and not the producer as there is no source and messages are not supposed to be produced
to the topic. But kafka channel still spins the producer and tries to connect to kafka broker.
If the producer configurations are not specified ( as it is not required) it fills the log
with Warning messages about issue in producer connection depending upon what missing configuration
is causing the connection failure.

For ex:- 
16 Oct 2019 13:28:39,996 WARN  [kafka-producer-network-thread | producer-6] (org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.handleDisconnection:725)
 - Bootstrap broker <broker>:9094 disconnected
..

This causes performance issue.

After providing the missing producer configuration, the warning goes away and everything works
fine.

It would be good, if producer is snot started if the kafka channel is configured without any
source.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@flume.apache.org
For additional commands, e-mail: issues-help@flume.apache.org


Mime
View raw message