chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jaydeep ayachit (JIRA)" <>
Subject [jira] Commented: (CHUKWA-526) Supporting sequential sequence number in chukwa agent
Date Wed, 29 Sep 2010 05:10:34 GMT


jaydeep ayachit commented on CHUKWA-526:

Hi Ari,

The sequence number is not available in ChukwaRecord. As per my understanding, case when file
is rotated, the sequence number would reset. The sequence number (record offsets) are used
to extract data from the chunk to pass it to demuxer for processing. As such if timestamp
is not available in file (or same timestamp across multiple lines) the ordering cannot be

> Supporting sequential sequence number in chukwa agent
> -----------------------------------------------------
>                 Key: CHUKWA-526
>                 URL:
>             Project: Chukwa
>          Issue Type: Improvement
>          Components: data collection
>            Reporter: jaydeep ayachit
> The current sequence number is offset in the data. Suggestion is to accompany sequential
number that will be available in ChukwaRecord. The sequence number will help to regenerate
log file order whenever needed (many times file does not have timestamp or same timestamp
for multiple lines). With sequence number, its also possible to query and manipulate using
query language like JAQL

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message