chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-422) Rewrite Demux for Hadoop0.20+
Date Fri, 04 Dec 2009 21:33:21 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786177#action_12786177
] 

Jerome Boulon commented on CHUKWA-422:
--------------------------------------

Sure, but if TFile/Avro are production ready I will probably move to use them too.
But from my understanding, TFile is going to be removed from Hadoop common so I will not bet
to much on that and Avro/SeqFile integration will not be completed on 0.21.


> Rewrite Demux for Hadoop0.20+
> -----------------------------
>
>                 Key: CHUKWA-422
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-422
>             Project: Hadoop Chukwa
>          Issue Type: Improvement
>          Components: MR Data Processors
>            Reporter: Jerome Boulon
>            Assignee: Jerome Boulon
>
> Demux is using the old M/R packages and need to be moved to the new MR API.
> Since I'm now using Hive by default, I will output to Hive table format.
> I will match the RT to a Hive schema and generate an output inline with that schema.
> I will make all of this pluggable but 
> Is there a need to still support the current Chukwa Output format?
> Also since I'm will no longer use the current Chukwa Output format, I no longer need
all Rolling classes?
> Is there a need to still support them?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message