gearpump-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manu Zhang (JIRA)" <>
Subject [jira] [Created] (GEARPUMP-40) KafkaSource poor performance
Date Wed, 20 Apr 2016 01:38:25 GMT
Manu Zhang created GEARPUMP-40:

             Summary: KafkaSource poor performance
                 Key: GEARPUMP-40
             Project: Apache Gearpump
          Issue Type: Improvement
          Components: kafka
    Affects Versions: 0.8.0
            Reporter: Manu Zhang
            Assignee: Manu Zhang

As per [],
a single thread Kafka consumer could consume at 89.7MB/s from 6x partition 3x replica topic.
I carried out a similar experiment with KafkaSource and found that the throughput is only
at 10MB/s.  

This message was sent by Atlassian JIRA

View raw message