Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-user@incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of asrabkin@gmail.com designates
 74.125.82.175 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=uT0ukdquFRCEeu3/mlqDtG3xtmhSnNn1OQQ0qs9+Fqbn8rRI+5ZpaaoqEZsca5QMl+
         lzHFM9EET6MJ9e5wlFmTFQWetq1EoMJeUHrvounkmubnM0PaVKcbPMIKIy8gXb9Vm7st
         LjWzI2jkuXEeDb0mHtZkTm+0Zoz0woJcwvJWQ=
MIME-Version: 1.0
In-Reply-To: <AANLkTikKcduXQxb7XohmKrL=1Goj9YRhNGgTH-HzvuFj@mail.gmail.com>
References: <AANLkTimLiCkpcU0ni43-GLJJnjVWyYOgfF19xztSSaG2@mail.gmail.com>
	<C9300F0C.E897%eyang@yahoo-inc.com>
	<AANLkTinEGCtA9OCWbKcY5S-gMGDgzqY5zAeC+yLny2kx@mail.gmail.com>
	<AANLkTikKcduXQxb7XohmKrL=1Goj9YRhNGgTH-HzvuFj@mail.gmail.com>
Date: Sun, 26 Dec 2010 10:08:20 -0800
Message-ID: <AANLkTikioacbTnTavuK4O0rx8yTTXSTxA9WnFrjqBKOF@mail.gmail.com>
Subject: Re: Using Chukwa as monitoring tool.
From: Ariel Rabkin <asrabkin@gmail.com>
To: chukwa-user@incubator.apache.org
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

Yes.  That 16 GB number is for the HICC server, not for the collection
side. And even then, it's if you have a lot of data (a whole cluster's
worth) living in a MySQL database with a web application serving the
data.

The monitoring agent and the collector are both fairly small-footprint.

--Ari

On Sun, Dec 26, 2010 at 10:03 AM, Akshay Kumar <kumar.akshay@gmail.com> wro=
te:
> Hi,
> Thanks for the responses. A bit late to check this one.
> I have one more query -
> In the Chukwa administration guide:
> http://people.apache.org/~eyang/docs/r0.1.2/admin.html
> It says
> Chukwa can also be installed on a single node, in which case the machine
> must have at least 16 GB of memory.
>
> Q) For my usecase ( for monitoring system metrics) - is it safe to assume=
 it
> is not going to be that big a requirement for memory?
>
> Thanks,
> Akshay
>
>
> On 17 December 2010 10:23, ZHOU Qi <zhouqi.jackson@gmail.com> wrote:
>>
>> Got it. Thanks.
>>
>> 2010/12/17 Eric Yang <eyang@yahoo-inc.com>:
>> > Sure, here you go.
>> >
>> > Regards,
>> > Eric
>> >
>> > On 12/16/10 6:21 PM, "ZHOU Qi" <zhouqi.jackson@gmail.com> wrote:
>> >
>> > Hi Eric,
>> >
>> > I read the wiki of Chukwa, but there is less information about HICC.
>> > From where I can get its screen-shot or demo?
>> >
>> > Thanks,
>> > 2010/12/17 Eric Yang <eyang@yahoo-inc.com>:
>> >> Hi Akshay,
>> >>
>> >> A) Yes. =A0You can use =93add sigar.SystemMetrics SystemMetrics [inte=
rval]
>> >> 0=94
>> >> to
>> >> stream CPU state at specified interval. =A0For example:
>> >>
>> >> =93add sigar.SystemMetrics SystemMetrics 5 0=94 without quotes will s=
tream
>> >> CPU
>> >> state every 5 seconds.
>> >>
>> >> B) Chukwa has a graphing tool built in which is called HICC. =A0It
>> >> requires
>> >> Hbase deployed in order to use HICC.
>> >>
>> >> However, agent is still required on the client machines.
>> >>
>> >> Regards,
>> >> Eric
>> >>
>> >> On 12/16/10 4:34 AM, "Akshay Kumar" <kumar.akshay@gmail.com> wrote:
>> >>
>> >> Hi,
>> >> I have a Hadoop installation, and I want to collect some basic OS lev=
el
>> >> metrics like=A0 - cpu, memory, disk usage, and Hadoop metrics.
>> >>
>> >> I have looked into Ganglia, but it requires installing agents on clie=
nt
>> >> machines, which is what I want to avoid.
>> >>
>> >> My queries:
>> >> a) Is this a fair use case for using chukwa? e.g. polling client
>> >> machines
>> >> for CPU stats few times per minute?
>> >> b) Is it possible to integrate data collected from chukwa collectors =
in
>> >> a
>> >> form readable by rrdtool kind of graphing tools on the server side?
>> >>
>> >> Thanks,
>> >> Akshay
>> >>
>> >>
>> >
>> >
>
>


--=20
Ari Rabkin asrabkin@gmail.com
UC Berkeley Computer Science Department