chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jiaqi Tan (JIRA)" <>
Subject [jira] Commented: (CHUKWA-348) SALSA State-machine Generation Driver
Date Tue, 14 Jul 2009 20:49:14 GMT


Jiaqi Tan commented on CHUKWA-348:

More of a "coming soon" and "I will work on it" feature, I am anticipating this will be completed
only in early August.

> SALSA State-machine Generation Driver
> -------------------------------------
>                 Key: CHUKWA-348
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>          Components: Data Processors
>    Affects Versions: 0.3.0
>            Reporter: Jiaqi Tan
>            Assignee: Jiaqi Tan
>            Priority: Critical
>             Fix For: 0.3.0
>   Original Estimate: 504h
>  Remaining Estimate: 504h
> Currently the state-machine generation can be run only via a standalone call to bin/
The plan is to subclass the AbstractDataLoader to automatically call the state-machine generation
when new data is available, and for this driver to automatically create output directories,
and decide which FSMBuilder mapper class to call (based on the log type). Then, the state-machine
records generated will be written to SeqFiles of ChukwaRecords that will get automatically
routed to the correct repos/ directory (by the PostProcessManager), and the MDL will automatically
load that to the database.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message