hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: Bulk import question.
Date Wed, 03 Dec 2008 08:38:00 GMT
One more, I wonder that the more map task, the more faster on any condition.

/Edward

On Tue, Dec 2, 2008 at 2:32 PM, Andrew Purtell <apurtell@yahoo.com> wrote:
> Hello Jonathan,
>
> +1 on sharing your Nagios plugins for Hadoop and HBase as a
> contrib. :-)
>
>   - Andy
>
>
>> From: Jonathan Gray <jlist@streamy.com>
>> Subject: RE: Bulk import question.
>> To: hbase-user@hadoop.apache.org
>> Date: Monday, December 1, 2008, 7:20 PM
>>
>> Your new best friends:  Ganglia and Nagios
>>
>> Ganglia is great for monitoring cluster-wide resource usage
>> over time.  You'll see memory, cpu, disk, network usage
>> over time for entire cluster and for each node.  It is very
>> easy to setup because it uses UDP broadcast so no need to
>> actually configure nodes in conf files.  HBase 0.19
>> introduces ganglia metrics which will also be available in
>> the ganglia web interface.
>>
>> http://ganglia.info/
>>
>> Nagios is good for monitoring services as well as resource
>> utilization.  Rather than give data over time, it's aim
>> is really to alert you when something is wrong.  For
>> example, when a server is no longer reachable or when
>> available disk space reaches a configurable threshold.  It
>> does require a bit more work to get up and running because
>> you have to setup your node and service configurations.  I
>> have written custom nagios plugins for hadoop and hbase, if
>> there's interest I will look at cleaning them up and
>> contrib'ing them.
>>
>> http://www.nagios.org/
>>
>> Both are free and essential tools for properly monitoring
>> your cluster.
>>
>> JG
>
>
>
>
>



-- 
Best Regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org

Mime
View raw message