Mailing-List: contact chukwa-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-dev@hadoop.apache.org
Message-ID: <1812662658.1242319245568.JavaMail.jira@brutus>
Date: Thu, 14 May 2009 09:40:45 -0700 (PDT)
From: "Ari Rabkin (JIRA)" <jira@apache.org>
To: chukwa-dev@hadoop.apache.org
Subject: [jira] Commented: (CHUKWA-30) Remove HDFS flush & connection
 holding (Collector)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/CHUKWA-30?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709463#action_12709463 ] 

Ari Rabkin commented on CHUKWA-30:
----------------------------------

Rock.

I think for now it makes sense to leave the direct-to-HDFS as default until we've done a bit more testing.  I was suggesting that we add all the relevant properties to chukwa-collector-conf.xml.  They shouldn't be commented out, but they should have innocuous defaults.

10X performance gain is impressive!  Is there some way we can actually force data to *local* disk before returning Acks, without losing all that speedup?

> Remove HDFS flush & connection holding (Collector)
> --------------------------------------------------
>
>                 Key: CHUKWA-30
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-30
>             Project: Hadoop Chukwa
>          Issue Type: Improvement
>          Components: data collection
>            Reporter: Jerome Boulon
>            Assignee: Jerome Boulon
>         Attachments: CHUKWA-30.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.