hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Trivial Update of "Chukwa_Processes_and_Data_Flow" by BillGraham
Date Wed, 03 Feb 2010 01:47:20 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "Chukwa_Processes_and_Data_Flow" page has been changed by BillGraham.
http://wiki.apache.org/hadoop/Chukwa_Processes_and_Data_Flow?action=diff&rev1=3&rev2=4

--------------------------------------------------

     * from: {{{demuxProcessing/mrOutput}}}
     * to: {{{dataSinkArchives/InError/[yyyyMMdd]/*/*.done}}} 
   1. PostProcessManager wakes up every few minutes and aggregates, orders and de-dups record
files.
-   * from: postProcess/demuxOutputDir_*/[clusterName]/[dataType]/[dataType]_[yyyyMMdd]_[HH].R.evt}}}
+   * from: {{{postProcess/demuxOutputDir_*/[clusterName]/[dataType]/[dataType]_[yyyyMMdd]_[HH].R.evt}}}
    * to: {{{repos/[clusterName]/[dataType]/[yyyyMMdd]/[HH]/[mm]/[dataType]_[yyyyMMdd]_[HH]_[N].[N].evt}}}

   1. HourlyChukwaRecordRolling runs M/R jobs at 16 past the hour to group 5 minute logs to
hourly.
    * from: {{{repos/[clusterName]/[dataType]/[yyyyMMdd]/[HH]/[mm]/[dataType]_[yyyyMMdd]_[mm].[N].evt}}}

Mime
View raw message