chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <>
Subject [jira] [Commented] (CHUKWA-648) Make Chukwa Reduce Type to support hierarchy format
Date Mon, 16 Jul 2012 21:36:34 GMT


Ari Rabkin commented on CHUKWA-648:

Overall approach looks solid. 

A few quibbles about the patch.

HierarchyDataType shouldn't have an empty main() method. 

HierarchyDataType SHOULD have a top-level Javadoc comment saying a bit about what it's for
and where it's used.
> Make Chukwa Reduce Type to support hierarchy format
> ---------------------------------------------------
>                 Key: CHUKWA-648
>                 URL:
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: Data Processors
>    Affects Versions: 0.4.0, 0.6.0
>            Reporter: Jie Huang
>         Attachments: Chukwa-648-0_4.patch
> Currently the Reduce Type decides the final directory-structure of the processed data
over HDFS. And it doesn't support a hierarchy format like 
> {noformat}
> hdfs/namenode
> hdfs/datanode
> ...
> {noformat}
> A hierarchy structure makes it easy to do the HDFS File Filter versus to the flat storage
structure while doing the analysis job.  

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message