hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sunduncan <sundun...@360buy.com>
Subject Re: hadoop simple monitor
Date Sat, 05 Jan 2013 09:36:23 GMT



发送时间:2013-01-05 17:30
主题:hadoop simple monitor

I write a bash script to monitor all nodes of Hadoop system. It can monitor 
memory, disk usage and hadoop,thirift,hbase process exit. 

Simple Monitor for Hadoop Processes, Memory and Diskspace usage. If memory 
and disk usage reaches to a threshold, or some hadoop system process exit, 
the program will send email to make warnings. 

   1. Simple Monitor Hadoop Processes, Memory and Diskspace usage of every 
   hosts that configured. 
   2. Deploy is simple. Just copy or uncompress the code to one station, 
   and it can monitor each remote hosts.( Do not need to deploy to any nodes 
   to be monitored.) 
   3. Write by Bash script, It's easy to modify. 
   4. It can monitor java processes(Such as HBase,Thrift,Hadoop processes) 
   or other processes(need a little change) 


Just copy or uncompress the code to a directory, configured to monitor all 
remote hosts, the remote hosts needn't any configure or deploy. 

   1. modify config.sh to configure parameters 
   2. check loopcheck.sh to modify paths, because crontab has a limited env 
   and PATH 
   3. check email sending is ok or not, you may need configure MTA such as 
   4. configure crontab, every 5 minutes check the hosts 

0-59/5 * * * * $HOME/smr/loopcheck.sh 

Download: https://code.google.com/p/hadoop-simple-monitor/ 

May it could help some body. 

Best Regards, 

Andy Zhou 
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message