chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <j...@apache.org>
Subject [jira] Updated: (CHUKWA-276) Hourly and Daily rolling should use a single reducer
Date Tue, 02 Jun 2009 17:45:07 GMT

     [ https://issues.apache.org/jira/browse/CHUKWA-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jerome Boulon updated CHUKWA-276:
---------------------------------

    Component/s: Data Processors
       Assignee: Jerome Boulon

> Hourly and Daily rolling should use a single reducer
> ----------------------------------------------------
>
>                 Key: CHUKWA-276
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-276
>             Project: Hadoop Chukwa
>          Issue Type: Improvement
>          Components: Data Processors
>            Reporter: Jerome Boulon
>            Assignee: Jerome Boulon
>
> Hourly and Daily rolling should not use more than one reducer and they are currently
relying on the default parameter to be correct.
> <property>
>   <name>mapred.reduce.tasks</name>
>   <value>1</value>
>   <description>The default number of reduce tasks per job.  Typically set
>   to a prime close to the number of available hosts.  Ignored when
>   mapred.job.tracker is "local".
>   </description>
> </property>
> This should be forced within the Rolling class in order to avoid any issue.
> And ideally, the code should be changed to allow more than one reducer.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message