chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ariel Rabkin <asrab...@gmail.com>
Subject another rc4 issue?
Date Thu, 14 May 2009 06:28:31 GMT
Also, the demux mapred jobs all fail almost immediately with an
out-of-memory.  The sort buffer sizes in chukwa-demux-conf are
incompatible with the Hadoop defaults.

I think we should dial down the default sizes in chukwa-demux-conf.
Outside Yahoo!, much smaller buffers should still be OK, since nobody
else will be running Chukwa at large scale for a while.

--Ari

-- 
Ari Rabkin asrabkin@gmail.com
UC Berkeley Computer Science Department

Mime
View raw message