Return-Path: Delivered-To: apmail-hadoop-chukwa-dev-archive@minotaur.apache.org Received: (qmail 80957 invoked from network); 9 Jun 2009 19:26:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 9 Jun 2009 19:26:18 -0000 Received: (qmail 84515 invoked by uid 500); 9 Jun 2009 19:26:30 -0000 Delivered-To: apmail-hadoop-chukwa-dev-archive@hadoop.apache.org Received: (qmail 84497 invoked by uid 500); 9 Jun 2009 19:26:30 -0000 Mailing-List: contact chukwa-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-dev@hadoop.apache.org Delivered-To: mailing list chukwa-dev@hadoop.apache.org Received: (qmail 84487 invoked by uid 99); 9 Jun 2009 19:26:30 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Jun 2009 19:26:30 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Jun 2009 19:26:28 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 6B7B9234C056 for ; Tue, 9 Jun 2009 12:26:07 -0700 (PDT) Message-ID: <1511654257.1244575567439.JavaMail.jira@brutus> Date: Tue, 9 Jun 2009 12:26:07 -0700 (PDT) From: "Jiaqi Tan (JIRA)" To: chukwa-dev@hadoop.apache.org Subject: [jira] Updated: (CHUKWA-282) Demux should output detailed per-operation ClientTrace records In-Reply-To: <1241453570.1244569567365.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CHUKWA-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaqi Tan updated CHUKWA-282: ----------------------------- Status: Patch Available (was: Open) > Demux should output detailed per-operation ClientTrace records > -------------------------------------------------------------- > > Key: CHUKWA-282 > URL: https://issues.apache.org/jira/browse/CHUKWA-282 > Project: Hadoop Chukwa > Issue Type: Improvement > Components: Data Processors > Affects Versions: 0.2.0 > Reporter: Jiaqi Tan > Assignee: Jiaqi Tan > Priority: Minor > Fix For: 0.2.0 > > Attachments: CHUKWA-282.patch > > > Currently, the ClientTrace reducer in Demux summarizes client trace operations to produce aggregate statistics for each type of operation (e.g. total bytes of local HDFS reads, total bytes of local HDFS writes). However, more sophisticated algorithms and visualization will need more detailed information such as amount of reads/writes to/from every pair of hosts. The ClientTrace reducer should also output the unsummarized, raw ClientTrace data so they can be used for analysis/visualization. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.