hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jakub Holy <jakub.h...@iterate.no>
Subject Does Hive expose anything useful over JMX?
Date Fri, 21 Sep 2012 16:00:50 GMT
Hello,

Does Hive expose any interesting information or stats over JMX, similarly
to Hadoop's JobTracker and NameNode?

I haven't found any in hive 0.8.1 even though f.ex.
https://issues.apache.org/jira/browse/HIVE-1818 would indicate that there
should be some metrics exposed.

(I executed Hive with -Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=8008 and connected to it with VisualVM,
making use of the MBeans extension to list whatever is available via JMX,
which worked well with Hadoop.)

Are there some alternative ways to get some monitoring information from
Hive? My motivation is that recently we had few hundred corrupted blocks
which drove Hive (accessed over Thrift) crazy, namely it was accepting
queries but never sent any jobs to the JobTracker and consumed lot of CPU
and memory. We weren't able to detect what is going on as there was nothing
significant in any log so a better monitoring is certainly needed.

Thank you!

Best Regards, Jakub Holy

-- 
*Code duplication is the root of all evil.
(Vær så snill og hjelp meg med å korrigere min norsk, skriftlig og muntlig.
Takk!)*

Jakub Holy
Solutions Engineer | +47 966 23 666
Iterate AS | www.iterate.no
The Lean Software Development Consultancy
- http://theholyjava.wordpress.com/ -

Mime
View raw message