chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-26) Rewrite processSinkFiles.sh in java to have a better error handling
Date Wed, 08 Apr 2009 23:20:13 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-26?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697307#action_12697307
] 

Jerome Boulon commented on CHUKWA-26:
-------------------------------------

>> finaArchive seems to create a lot of files. Could we fine tune this to reduce number
of files? 
There's a parameter to control the number of output files: chukwaArchiveBuilder.reduceCount

<property>
    <name>chukwaArchiveBuilder.reduceCount</name>
    <value>5</value>
    <description>Reduce count </description>
  </property>

>> Demux probably should call System.gc after each run to keep resource usage as lean
as possible since it's a daemon process.
DemuxManager is scheduling the demux Job but does not actually compute it since it's a M/R
Job, so memory for DemuxManager should
be low and stable.


> Rewrite processSinkFiles.sh in java to have a better error handling
> -------------------------------------------------------------------
>
>                 Key: CHUKWA-26
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-26
>             Project: Hadoop Chukwa
>          Issue Type: Improvement
>          Components: Data Processors
>            Reporter: Jerome Boulon
>            Assignee: Jerome Boulon
>            Priority: Blocker
>         Attachments: CHUKWA-26-2.patch, CHUKWA-26.patch, NagiosAppender-1.5.0.jar
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message