kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "huxihx (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5560) LogManager should be able to create new logs based on free disk space
Date Fri, 07 Jul 2017 02:52:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077506#comment-16077506

huxihx commented on KAFKA-5560:

[~junrao] Do you see it as a reasonable requirement?

> LogManager should be able to create new logs based on free disk space
> ---------------------------------------------------------------------
>                 Key: KAFKA-5560
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5560
>             Project: Kafka
>          Issue Type: Improvement
>          Components: log
>    Affects Versions:
>            Reporter: huxihx
> Currently, log manager chooses a directory configured in `log.dirs` by calculating the
number partitions in each directory and then choosing the one with the fewest partitions.
But in some real production scenarios where data volumes of partitions are not even, some
disks nearly become full whereas the others have a lot of spaces which lead to a poor data
> We should offer a new strategy to users to have log manager honor the real disk free
spaces and choose the directory with the most disk space. Maybe a new broker configuration
parameter is needed, `log.directory.strategy` for instance. Perhaps this needs a new KIP also.
> Does it make sense?

This message was sent by Atlassian JIRA

View raw message