chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] Created: (CHUKWA-76) Add automated data expiration for mr job data and mr task data
Date Wed, 01 Apr 2009 04:55:50 GMT
Add automated data expiration for mr job data and mr task data
--------------------------------------------------------------

                 Key: CHUKWA-76
                 URL: https://issues.apache.org/jira/browse/CHUKWA-76
             Project: Hadoop Chukwa
          Issue Type: New Feature
          Components: Data Processors
         Environment: Redhat 5.1, Java 6
            Reporter: Eric Yang
            Assignee: Eric Yang


Mapred job data and mapred task data collected to database table requires down sampling. 
The data needs to be expired after a fixed time window.  There should be roll up and move
data to different partition when necessary.  The current model is to expire every two time
partition, and move the expired data to the larger partition.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message