kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jay Kreps (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-266) Kafka web console design
Date Wed, 14 Mar 2012 21:16:37 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13229629#comment-13229629

Jay Kreps commented on KAFKA-266:

My take is that, as Joe says, most serious folks already have some system they use for monitoring
across their stack (ganglia or whatever). To really work operationally you can't try to replace
this or add a new system. For this reason, I kind of prefer the web app to be an optional
stand-alone thing since it may not be of use to everyone, though i think that complicates
its design (potentially). I think the advantage of the web app is custom display of very kafka-specific
things (the audit, cluster status, etc).
> Kafka web console design
> ------------------------
>                 Key: KAFKA-266
>                 URL: https://issues.apache.org/jira/browse/KAFKA-266
>             Project: Kafka
>          Issue Type: New Feature
>          Components: contrib
>            Reporter: Evan Chan
>   Original Estimate: 672h
>  Remaining Estimate: 672h
> This issue is created to track a community-contributed Kafka Web UI.
> Here is an initial list of goals:
> - Be able to easily see which brokers are up
> - Be able to see lists of topics, connected producers, consumer groups, connected consumers
> - Be able to see, for each consumer/partition, its offset, and more importantly, # of
bytes unconsumed (== largest offset for partition - current offset)
> - (Wish list) have a graphical view of the offsets
> - (Wish list) be able to clean up consumer state, such as stale claimed partitions
> List of challenges/questions:
> - Which framework?  Play! for Scala?
> - Is all the data available from JMX and ZK?  Hopefully, watching the files on the filesystem
can be avoided....
> - How to handle large numbers of topics, partitions, consumers, etc. efficiently

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message