chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <j...@apache.org>
Subject [jira] Created: (CHUKWA-276) Hourly and Daily rolling should use a single reducer
Date Tue, 02 Jun 2009 17:45:07 GMT
Hourly and Daily rolling should use a single reducer
----------------------------------------------------

                 Key: CHUKWA-276
                 URL: https://issues.apache.org/jira/browse/CHUKWA-276
             Project: Hadoop Chukwa
          Issue Type: Improvement
            Reporter: Jerome Boulon


Hourly and Daily rolling should not use more than one reducer and they are currently relying
on the default parameter to be correct.

<property>
  <name>mapred.reduce.tasks</name>
  <value>1</value>
  <description>The default number of reduce tasks per job.  Typically set
  to a prime close to the number of available hosts.  Ignored when
  mapred.job.tracker is "local".
  </description>
</property>


This should be forced within the Rolling class in order to avoid any issue.
And ideally, the code should be changed to allow more than one reducer.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message