chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (CHUKWA-278) Improve post process manager and metric data loader to support data loading from pig aggregation
Date Mon, 08 Jun 2009 21:50:07 GMT

     [ https://issues.apache.org/jira/browse/CHUKWA-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eric Yang updated CHUKWA-278:
-----------------------------

    Attachment: CHUKWA-278.patch

- Add new DataLoaderFactory.
- Added ability to determine time partition base on record type.

> Improve post process manager and metric data loader to support data loading from pig
aggregation
> ------------------------------------------------------------------------------------------------
>
>                 Key: CHUKWA-278
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-278
>             Project: Hadoop Chukwa
>          Issue Type: Improvement
>          Components: Data Processors
>         Environment: Redhat EL 5.1, Java 6
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.2.0
>
>         Attachments: CHUKWA-278.patch
>
>
> The current post process manager loads sequence file to database only.  Ideally, the
post process manager should be able to load data into different data loader.  Hence, DataLoaderFactory
should be defined as an interface or abstract class for third party to implement their own
data loader.  The current implementation of pig aggregator generates down sampled data as
different record type.  There should be a new capability for Metric Data Loader to identify
table partition base on record type.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message