chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shweta Shah (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CHUKWA-589) Functionality allowing collectors to close .chukwa files at a fixed offset inside the rotateInterval
Date Mon, 20 Jun 2011 18:42:53 GMT

     [ https://issues.apache.org/jira/browse/CHUKWA-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shweta Shah updated CHUKWA-589:
-------------------------------

    Attachment: CHUKWA-589_2.patch

We have made the required changes to the default.properties and build.xml files. Additionally,
the default value (false) for property chukwaCollector.isFixedTimeRotatorScheme is also included
in default.properties now.

{noformat}
<property>
    <name>chukwaCollector.isFixedTimeRotatorScheme</name>
    <value>@TODO-COLLECTORS-ISFIXEDTIMEROTATORSCHEME</value>
    <description>A flag to indicate that the collector should close at a fixed
    offset after every rotateInterval. The default value is false which uses
    the default scheme where collectors close after regular rotateIntervals.
    If set to true then specify chukwaCollector.fixedTimeIntervalOffset value.
    e.g., if isFixedTimeRotatorScheme is true and fixedTimeIntervalOffset is
    set to 10000 and rotateInterval is set to 300000, then the collector will
    close its files at 10 seconds past the 5 minute mark, if
    isFixedTimeRotatorScheme is false, collectors will rotate approximately
    once every 5 minutes
    </description>
</property>
{noformat}

Attached please find the version 2 of the patch - CHUKWA-589_2.patch with all changes.


> Functionality allowing collectors to close .chukwa files at a fixed offset inside the
rotateInterval
> ----------------------------------------------------------------------------------------------------
>
>                 Key: CHUKWA-589
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-589
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: data collection
>    Affects Versions: 0.5.0
>            Reporter: Himanshu Gahlot
>         Attachments: CHUKWA-589_1.patch, CHUKWA-589_2.patch
>
>
> We have a system built on top of Chukwa that introduces the need to have all .chukwa
files for a given rotateInterval closed and available at a predictable time.  Currently, we
are experience some drift in the times that the sequence files are closed due to the way the
TimerTask is scheduled in the SeqFileWriter class.  We would like to submit a solution that
will allow people to configure the time all collectors should close their files for processing
in a given interval, while still supporting the default functionality. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message