chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <>
Subject [jira] Commented: (CHUKWA-422) Rewrite Demux for Hadoop0.20+
Date Fri, 04 Dec 2009 21:33:21 GMT


Jerome Boulon commented on CHUKWA-422:

Sure, but if TFile/Avro are production ready I will probably move to use them too.
But from my understanding, TFile is going to be removed from Hadoop common so I will not bet
to much on that and Avro/SeqFile integration will not be completed on 0.21.

> Rewrite Demux for Hadoop0.20+
> -----------------------------
>                 Key: CHUKWA-422
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: Improvement
>          Components: MR Data Processors
>            Reporter: Jerome Boulon
>            Assignee: Jerome Boulon
> Demux is using the old M/R packages and need to be moved to the new MR API.
> Since I'm now using Hive by default, I will output to Hive table format.
> I will match the RT to a Hive schema and generate an output inline with that schema.
> I will make all of this pluggable but 
> Is there a need to still support the current Chukwa Output format?
> Also since I'm will no longer use the current Chukwa Output format, I no longer need
all Rolling classes?
> Is there a need to still support them?

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message