incubator-chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Yang <ey...@yahoo-inc.com>
Subject Re: why mysql db no data
Date Wed, 03 Mar 2010 17:38:30 GMT
Hi,

Chukwa-hadoop-0.3.0-client.jar should be copied to HADOOP_HOME/lib for
Hadoop to initialize the logger.  Without it, Hadoop still works, but
nothing is getting logged.  Once you copied over the file, you should
restart Hadoop again.  Hope this helps.

Regards,
Eric

On 3/3/10 1:07 AM, "Smith Hua" <smithh@sz.webex.com> wrote:

> Thanks for your reply, Eric
>  
> I found the systemDataLoader.sh may be the new one like systemMetrics.sh in
> 0.3.0
> And which shell is used to collect hadoop metrics in 0.3.0
>  
> I installed chukwa on one agent without hadoop environment, can i use
> systemMetrics.sh to collect
> system information
>  
> with the configure to collect hadoop metrics, need to configure like
>  
>    1. Copy CHUKWA_HOME/conf/hadoop-log4j.properties file to
> HADOOP_HOME/conf/log4j.properties
>    2. Copy CHUKWA_HOME/conf/hadoop-metrics.properties file to
> HADOOP_HOME/conf/hadoop-metrics.properties
>    3. Edit HADOOP_HOME/conf/hadoop-metrics.properties file and change
> @CHUKWA_LOG_DIR@ to your actual CHUKWA log dirctory (ie, CHUKWA_HOME/var/log)
>  
> But when restart the start-mapred.sh , catch the exception
> log4j:ERROR Could not instantiate class
> [org.apache.hadoop.chukwa.inputtools.log4j.ChukwaDailyRollingFileAppender].
> xx1-19: java.lang.ClassNotFoundException:
> org.apache.hadoop.chukwa.inputtools.log4j.ChukwaDailyRollingFileAppender
> xx1-19:        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> xx1-19:        at java.security.AccessController.doPrivileged(Native Method)
> xx1-19:        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> xx1-19:        at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> xx1-19:        at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> xx1-19:        at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
> xx1-19:        at java.lang.Class.forName0(Native Method)
> xx1-19:        at java.lang.Class.forName(Class.java:169)
> But the daemon can still work, does this matter in running hadoop?
>  
> 2010-03-03 00:58:17,"Eric Yang" <eyang@yahoo-inc.com> wrote:
>> Hi,
>> 
>> /var/message is not stored into mysql.  The only data goes into mysql are
>> the system metrics and hadoop metrics. System metrics is composed of top,
>> iostat, sar, and df.  You need to start up systemMetrics.sh to get system
>> related data injected into mysql.
>> 
>> Regards,
>> Eric
> 


Mime
View raw message