incubator-chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Yang <ey...@yahoo-inc.com>
Subject Re: Chukwa cluster configure
Date Sun, 06 Jun 2010 19:31:39 GMT
Hi,

MDL has been deprecated in Chukwa 0.4.  MDL used to load chukwa records from
demux (/chukwa/repos) to mysql, but it doesn’t load dataSinkArchives to
database.  It is possible to use existing mdl.sh from 0.3 to load data to
database, but it is not officially supported.

Regards,
Eric

On 6/6/10 2:00 AM, "周鹏" <zhoupeng19850225@gmail.com> wrote:

>   Hi,I'm use Chukwa  to  monitoring my hadoop cluster log.This is my
> configuration :
> initial_adaptors:
> add DirTailingAdaptor logs /data/hadoopdisk/logs/  *.log.* 
> filetailer.CharFileTailingAdaptorUTF8 0
> 
> jdbc.conf:
> chukwa=jdbc:mysql://10.19.0.175:3306/chukwa?user=rmss
> <http://10.19.0.175:3306/chukwa?user=rmss>
> 
> chukwa-collector-conf.xml:
> ......
>   <property>
>     <name>writer.hdfs.filesystem</name>
>     <value>hdfs://c3-1:9000/</value>
>     <description>HDFS to dump to</description>
>   </property>
> 
>   <property>
>     <name>chukwaCollector.outputDir</name>
>     <value>/chukwa/logs/</value>
>     <description>Chukwa data sink directory</description>
>   </property>
> ......
> 
> I'm running the bin/start-collector.sh at first,and then /start-agents.sh.When
> the data is collected(in the dir /chukwa/logs on HDFS),I'm running the
> bin/start-data-processors.sh,and the data is move from /chukwa/logs to
> /chukwa/dataSinkArchives.The question is :
> How can i insert the data in /chukwa/dataSinkArchives to Mysql? I found that
> in the Chukwa 0.3.0 <http://hadoop.apache.org/chukwa/docs/r0.3.0/>  there are
> some script like mdl.sh...but I'm use 0.4.0.
> 
> 
> Thanks!
> 
> 
> 


Mime
View raw message