hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "ManagementTools" by JeffHammerbacher
Date Mon, 16 Nov 2009 11:59:54 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "ManagementTools" page has been changed by JeffHammerbacher.
http://wiki.apache.org/hadoop/ManagementTools?action=diff&rev1=2&rev2=3

--------------------------------------------------

  
  The other thing to be aware of is that the troublesome workers are not the dead ones; they
are easy to detect; they don't report for duty. The troublesome ones are the nodes where the
disk is playing up so badly that the system is really slow, so their work takes too long.
Or their RAM isn't working properly so only 1GB of it appears there, and every job fails with
memory problems. Or some strange motherboard/CPU/OS combination causes a machine to find race
conditions in code where none surface elsewhere. That's what you need to identify: the troublemakers.
Once found, you can set up Hadoop to blacklist nodes.
  
- For detailed information, see Ed Capriolo's [[presentation|http://www.cloudera.com/blog/2009/11/09/hadoop-world-monitoring-best-practices-from-ed-capriolo/]]
from Hadoop World NYC 2009.
+ For detailed information, see Ed Capriolo's [[http://www.cloudera.com/blog/2009/11/09/hadoop-world-monitoring-best-practices-from-ed-capriolo/|presentation]]
from Hadoop World NYC 2009.
  
  == Nagios ==
  
@@ -18, +18 @@

  
  == JMX Support ==
  
- Hadoop has JMX support, so with the right JMX bridge for your chosen management tools, it
should be possible to keep an eye on Hadoop from your favorite management console. For more
on JMX and Hadoop, see Philip Zeyliger's [[blog post|http://www.cloudera.com/blog/2009/03/12/hadoop-metrics/]]
on the Cloudera blog.
+ Hadoop has JMX support, so with the right JMX bridge for your chosen management tools, it
should be possible to keep an eye on Hadoop from your favorite management console. For more
on JMX and Hadoop, see Philip Zeyliger's [[http://www.cloudera.com/blog/2009/03/12/hadoop-metrics/|blog
post]] on the Cloudera blog.
  
  === JMX Bridging to Zenoss ===
  
@@ -40, +40 @@

  
  == Cacti ==
  
- See Ed Capriolo's [[blog post|http://www.cloudera.com/blog/2009/07/07/hadoop-graphing-with-cacti/]]
about how About.com uses Cacti for monitoring their Hadoop cluster.
+ See Ed Capriolo's [[http://www.cloudera.com/blog/2009/07/07/hadoop-graphing-with-cacti/|blog
post]] about how About.com uses Cacti for monitoring their Hadoop cluster.
  

Mime
View raw message