incubator-chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Yang <ey...@yahoo-inc.com>
Subject Re: Survey - Chukwa usage
Date Fri, 26 Feb 2010 00:25:28 GMT
Cluster Status ­ business dev
Cluster Size ­ 10 nodes
Chukwa Usage: monitoring + analytics
Cluster: yahoo data center
All components
Data analytics: pig+MR
Agent less solution: no preference
Hive: no preference

What is missing:
- Missing good storage format.
- Missing good post demux report generator.
- Missing good data retention process.
- Missing full body index for Archive for search, i.e. find log entries.
- The list goes on and on...

It will take time to build all those features.

Regards,
Eric

On 2/24/10 9:41 AM, "Jerome Boulon" <jboulon@netflix.com> wrote:

> Hi,
> I would like to get some stats on how Chukwa is used?
> Thanks in advance,
>   /Jerome.
> 
> * cluster status 
>> * personal 
>> * business ­ experiment
>> * business ­ dev
>> * business ­ test
>> * business ­ prod
> 
> * cluster size
>> * < 10 nodes 
>> * < 100 nodes 
>> * < 200 nodes 
>> * < 500 nodes 
>> * > 1000 nodes
> 
> * Chukwa usage
>> * monitoring 
>> * analytics
> 
> * Are you using Chukwa to collect:
>> * Log files 
>> * Metrics information
> 
> * Cluster running
>> * in your own data center
>> * in the cloud (ex: amazon ec2)
> 
> * which Chukwa components are you using?
>> * UI (HICC) 
>> * Log4j Appender
>> * Agent adaptors (list)
>> * Archiver 
>> * Demuxer
> 
> * Data analytics on ChukwaRecords
>> * pig 
>> * M/R
> 
> * Would you be interested in an agent less solution?
> 
> * Would you like to be able to use Hive instead of/in addition to Pig?
> 
> * What from your point of view is missing in Chukwa, today?
> 
> 


Mime
View raw message