chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <>
Subject [jira] Commented: (CHUKWA-282) Demux should output detailed per-operation ClientTrace records
Date Thu, 11 Jun 2009 08:11:07 GMT


Ari Rabkin commented on CHUKWA-282:

Looks okay to me, but I don't feel like I know that part of the code well enough to be 100%
sure, so I'd prefer if Eric or Jerome gave it a +1. 

Also.  Is it practical to unit-test this?  We like to get new unit tests for each nontrivial
change to the Java code.

> Demux should output detailed per-operation ClientTrace records
> --------------------------------------------------------------
>                 Key: CHUKWA-282
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: Improvement
>          Components: Data Processors
>    Affects Versions: 0.2.0
>            Reporter: Jiaqi Tan
>            Assignee: Jiaqi Tan
>            Priority: Minor
>             Fix For: 0.2.0
>         Attachments: CHUKWA-282.patch
> Currently, the ClientTrace reducer in Demux summarizes client trace operations to produce
aggregate statistics for each type of operation (e.g. total bytes of local HDFS reads, total
bytes of local HDFS writes). However, more sophisticated algorithms and visualization will
need more detailed information such as amount of reads/writes to/from every pair of hosts.
The ClientTrace reducer should also output the unsummarized, raw ClientTrace data so they
can be used for analysis/visualization.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message