hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "Anomaly Detection Framework with Chukwa" by JiaqiTan
Date Thu, 11 Jun 2009 07:55:42 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by JiaqiTan:
http://wiki.apache.org/hadoop/Anomaly_Detection_Framework_with_Chukwa

------------------------------------------------------------------------------
  
  ==== Task-based Anomaly Detection ====
  
- 
- 
   1. ({{{FSMBuilder}}}, available soon) SALSA is used to extract state-machine views of Hadoop's
execution - uses post-Demux output; uses {{{JobData/JobHistory}}}
-  1. (MapReduce job) Collect states from state-machine view and process them to generate
list of anomalous nodes, possibly list of anomalous nodes per unit time for incremental/online
diagnosis of anomalies
+  1. (MapReduce job) Collect states from state-machine view and process them to generate
list of anomalous nodes, possibly list of anomalous nodes per unit time for incremental/online
diagnosis of anomalies (described in Section 8 of [http://www.usenix.org/event/wasl08/tech/full_papers/tan/tan_html/
SALSA])
   1. Load anomaly data into RDBMS using MDL
   1. Visualization of heatmaps using HICC widget
  
- 

Mime
View raw message