chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] Created: (CHUKWA-430) Narrow down input for FSM mapreduce job
Date Mon, 14 Dec 2009 15:46:18 GMT
Narrow down input for FSM mapreduce job
---------------------------------------

                 Key: CHUKWA-430
                 URL: https://issues.apache.org/jira/browse/CHUKWA-430
             Project: Hadoop Chukwa
          Issue Type: Bug
          Components: MR Data Processors
    Affects Versions: 0.4.0
            Reporter: Eric Yang
            Assignee: Eric Yang
             Fix For: 0.4.0


FSMDataloader supplies all demux output data to FSM state machine.  This is not efficient
because most of the data type do not contribute to state generation.  According to Jiaqi,
the state machine requires the following types:

 JobHistoryTaskDataMapper:

/chukwa/repos/chukwa/JobData
/chukwa/repos/chukwa/TaskData

TaskTrackerClientTraceMapper:

/chukwa/repos/chukwa/ClientTraceDetailed

DataNodeClientTraceMapper:

/chukwa/repos/chukwa/ClientTraceDetailed


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message