hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HADOOP-4710) Chukwa - Add duplicate detection, and implement virtual offset of the log file to checkpoint file
Date Sun, 08 Mar 2009 01:04:56 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-4710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eric Yang resolved HADOOP-4710.
-------------------------------

    Resolution: Duplicate

This is integrated by patch for HADOOP-4709.

> Chukwa - Add duplicate detection, and implement virtual offset of the log file to checkpoint
file
> -------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-4710
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4710
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/chukwa
>         Environment: Redhat EL 4.5, Java 1.6, Hadoop Trunk
>            Reporter: Eric Yang
>
> Each data stream has been sent to Chukwa with sequence id, and this sequence id is used
as the guide line for tracking duplicate chunk data in Chukwa.  However, the check point file
does not include the virtual offset.  This means when collector crashed, sequence id is reset
to zero.  Chukwa Agent needs to keep track of the sequence id in the check point file in order
to recover from a crash.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message