chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-239) demux settings should work correctly out-of-the-box
Date Thu, 14 May 2009 18:07:45 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709504#action_12709504
] 

Jerome Boulon commented on CHUKWA-239:
--------------------------------------

Ari, yes for the one you changed, on my laptop I'm running with similar setting however you
may also want to change the default value for io.sort.factor to be 10.
But be careful, there's a bug in Demux.java, demux force a load of the config coming from
CHUKWA_HOME/conf so if you have a separate config dir then you will only see the default value.
I'm not sure if I have open a Jira for that but I will fix it early next week.


> demux settings should work correctly out-of-the-box
> ---------------------------------------------------
>
>                 Key: CHUKWA-239
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-239
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: Data Processors
>            Reporter: Ari Rabkin
>            Priority: Critical
>         Attachments: CHUKWA-239.patch
>
>
> The sort buffer sizes in chukwa-demux-conf are incompatible with the Hadoop defaults.

> As a result, the demux mapred jobs all fail almost immediately with an
> out-of-memory if run on an out-of-the-box Hadoop. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message