chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ariel Rabkin <asrab...@gmail.com>
Subject Re: another rc4 issue?
Date Thu, 14 May 2009 16:33:19 GMT
I just opened CHUKWA-239 for this.  It should be a near-trivial patch.

Am I right in assuming that Yahoo! has internal corporate settings
which will override chukwa-demux-conf anyway?

--Ari

On Thu, May 14, 2009 at 8:04 AM, Cheng Zhang <chzhang@yahoo-inc.com> wrote:
> +1. As an open source project, the default settings should be workable.
>
>
>
>> -----Original Message-----
>> From: Ariel Rabkin [mailto:asrabkin@gmail.com]
>> Sent: Wednesday, May 13, 2009 11:29 PM
>> To: chukwa-dev@hadoop.apache.org
>> Subject: another rc4 issue?
>>
>> Also, the demux mapred jobs all fail almost immediately with an
>> out-of-memory.  The sort buffer sizes in chukwa-demux-conf are
>> incompatible with the Hadoop defaults.
>>
>> I think we should dial down the default sizes in chukwa-demux-conf.
>> Outside Yahoo!, much smaller buffers should still be OK, since nobody
>> else will be running Chukwa at large scale for a while.
>>
>> --Ari
>>
>> --
>> Ari Rabkin asrabkin@gmail.com
>> UC Berkeley Computer Science Department
>



-- 
Ari Rabkin asrabkin@gmail.com
UC Berkeley Computer Science Department

Mime
View raw message