kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Stopford (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (KAFKA-1464) Add a throttling option to the Kafka replication tool
Date Fri, 01 Jul 2016 09:58:11 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ben Stopford reassigned KAFKA-1464:
-----------------------------------

    Assignee: Ben Stopford  (was: Ismael Juma)

> Add a throttling option to the Kafka replication tool
> -----------------------------------------------------
>
>                 Key: KAFKA-1464
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1464
>             Project: Kafka
>          Issue Type: New Feature
>          Components: replication
>    Affects Versions: 0.8.0
>            Reporter: mjuarez
>            Assignee: Ben Stopford
>            Priority: Minor
>              Labels: replication, replication-tools
>             Fix For: 0.10.1.0
>
>
> When performing replication on new nodes of a Kafka cluster, the replication process
will use all available resources to replicate as fast as possible.  This causes performance
issues (mostly disk IO and sometimes network bandwidth) when doing this in a production environment,
in which you're trying to serve downstream applications, at the same time you're performing
maintenance on the Kafka cluster.
> An option to throttle the replication to a specific rate (in either MB/s or activities/second)
would help production systems to better handle maintenance tasks while still serving downstream
applications.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message