incubator-chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <>
Subject [jira] Commented: (CHUKWA-30) Remove HDFS flush & connection holding (Collector)
Date Thu, 14 May 2009 16:40:45 GMT


Ari Rabkin commented on CHUKWA-30:


I think for now it makes sense to leave the direct-to-HDFS as default until we've done a bit
more testing.  I was suggesting that we add all the relevant properties to chukwa-collector-conf.xml.
 They shouldn't be commented out, but they should have innocuous defaults.

10X performance gain is impressive!  Is there some way we can actually force data to *local*
disk before returning Acks, without losing all that speedup?

> Remove HDFS flush & connection holding (Collector)
> --------------------------------------------------
>                 Key: CHUKWA-30
>                 URL:
>             Project: Hadoop Chukwa
>          Issue Type: Improvement
>          Components: data collection
>            Reporter: Jerome Boulon
>            Assignee: Jerome Boulon
>         Attachments: CHUKWA-30.patch

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message