chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CHUKWA-670) Use ZooKeeper for collector list and adaptor check list
Date Thu, 29 Nov 2012 07:24:58 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506281#comment-13506281
] 

Eric Yang commented on CHUKWA-670:
----------------------------------

Collector list can be either retrieved from ZooKeeper or use local configuration file, if
one exists.
Check point file remain as is, is also preferred to reduce network traffic.  Would it make
sense to have configuration part of check point file in ZooKeeper, and agent get notified
when configuration changes?  While the offset and runtime information kept as it to reduce
network traffic?
                
> Use ZooKeeper for collector list and adaptor check list
> -------------------------------------------------------
>
>                 Key: CHUKWA-670
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-670
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: Data Collection
>         Environment: Java, ZooKeeper, Chukwa
>            Reporter: Eric Yang
>
> Agent is currently using local disk to storage check point file, and collector list.
 This can be hard to manage for large scale system that needs to be updated more frequently.
 The proposal is to have a new configuration in chukwa agent configuration file to enable
ZooKeeper as the location to store check point file and collector list.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message