kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "kaushik srinivas (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-7667) Need synchronous records send support for kafka performance producer java application.
Date Thu, 22 Nov 2018 09:41:00 GMT
kaushik srinivas created KAFKA-7667:
---------------------------------------

             Summary: Need synchronous records send support for kafka performance producer
java application.
                 Key: KAFKA-7667
                 URL: https://issues.apache.org/jira/browse/KAFKA-7667
             Project: Kafka
          Issue Type: Improvement
          Components: tools
    Affects Versions: 2.0.0
            Reporter: kaushik srinivas
            Assignee: kaushik srinivas


Why synchronous send support for performance producer ?

ProducerPerformance java application is used for load testing kafka brokers.
Load testing involves replicating very high throughput records flowing in to kafka brokers
and 
many producers in field would use synchronous way of sending data i.e blocking until the message
has been 
written completely on all the min.insyc.replicas no of brokers.

Asynchronous sends would satisfy the first requirement of loading kafka brokers.

This requirement would help in performance tuning the kafka brokers when producers are deployed
with "acks": all, "min.insync.replicas" :
equal to replication factor and synchronous way of sending. 
Throughput degradation happens with synchronous producers and this would help in 
tuning resources for replication in kafka brokers. 
Also benchmarks could be made from kafka producer perspective with synchronous way of sending
records and tune kafka producer's 
resources appropriately.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message