kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "xiongqi wu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-7362) enable kafka broker to remove orphan partitions automatically
Date Fri, 31 Aug 2018 00:10:00 GMT
xiongqi wu created KAFKA-7362:
---------------------------------

             Summary: enable kafka broker to remove orphan partitions automatically 
                 Key: KAFKA-7362
                 URL: https://issues.apache.org/jira/browse/KAFKA-7362
             Project: Kafka
          Issue Type: Improvement
          Components: core, log
            Reporter: xiongqi wu
            Assignee: xiongqi wu


When partition reassignment removes topic partitions from a offline broker, those removed
partitions become orphan partitions to the broker. When the offline broker comes back online,
it is not able to clean up both data and folders that belong to orphan partitions.  Log manager
will scan all all dirs during startup, but the time based retention policy on a topic partition
will not be kicked out until the broker is either a follower or a leader of the partition. 
In addition, we do not have logic to delete folders that belong to orphan partition today.


Open this ticket to provide a mechanism (when enabled) to safely remove orphan partitions
automatically.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message