Mailing-List: contact chukwa-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-dev@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of tanjiaqi@gmail.com designates
 74.125.83.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type:content-transfer-encoding;
        b=f4RxPjGauzNlJZkoX9Skarg8FknieyQmousSE1EeKXo9I3nXHX7M+vLut2hGRIjuuI
         5+6CyDjyY1VgomS1cjebjOuxV6Z/2PrJce4hGkOQLc9QNOtY3Kl0xOwqzZwjfvNJhBta
         lr+l9e635z5De0H/0PjF9L23EJyQRCBgAIUnk=
MIME-Version: 1.0
In-Reply-To: <i2u39b0afc01004271428s71169585g771298fcb8b34eb5@mail.gmail.com>
References: <v2t1b0d5eca1004271340x35b9422cs3c091d332fd8c1c6@mail.gmail.com>
	<i2u39b0afc01004271428s71169585g771298fcb8b34eb5@mail.gmail.com>
From: Jiaqi Tan <tanjiaqi@gmail.com>
Date: Wed, 28 Apr 2010 08:40:47 +0800
Message-ID: <t2vf80a104a1004271740o59ec5f22p2b620381fd433685@mail.gmail.com>
Subject: Re: Exploring chukwa-initial questions!
To: chukwa-dev@hadoop.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi Arvind,

Welcome to the mailing list :)

I have been using Chukwa slightly differently from most; I have been
using it in an "offline" mode to process Hadoop logs and other system
metrics by using the backfill loader, which is a special mode for
loading logs previously generated.

I work on failure diagnosis and visualization of system behavior for
Hadoop, and I have been using Chukwa to help with that. Some of our
previous work has already been implemented and is available in Chukwa,
and I have been working on putting more of the stuff in (albeit at a
much slower rate than I would like).

Jiaqi

On Wed, Apr 28, 2010 at 5:28 AM, Ariel Rabkin <asrabkin@gmail.com> wrote:
> My lab-mates use chukwa regularly on EC2 to monitor test deployments.
> Nothing particularly distinctive about it.
>
> Our deployment model is typically to run the agents in the cloud, and
> the collector at Berkeley, pointing to a static HDFS cluster holding
> the collected logs.
>
> --Ari
>
> On Tue, Apr 27, 2010 at 1:40 PM, arvind subramanian
> <always.arvind@gmail.com> wrote:
>> Hello,
>>
>> Firstly, Congrats on the release of 0.4!
>>
>> I am Arvind, and I =C2=A0have just got started in exploring Chukwa
>>
>> I have been reading =C2=A0the docs from the release in 0.40 , issues on =
JIRA, and
>> some of the activity in the mailing list.
>>
>> I am familiar with Hadoop/Hdfs having used them in pseudo-distributed mo=
de
>> on laptop(Ubuntu 9.10), and =C2=A0have also used hadoop AMI =C2=A0on Ec2=
.
>>
>> Has a Chukwa cluster been deployed on Ec2 ? If so, it would be great to =
see
>> some documentation/tutorials/pointers =C2=A0of the same, so that I could=
 try it
>> out.
>>
>> Also,It would be nice to see more elaboration on setting up the developm=
ent
>> environment for =C2=A0Chukwa (pseudo-distributed mode)
>>
>> Regards,
>> Arvind
>>
>
>
>
> --
> Ari Rabkin asrabkin@gmail.com
> UC Berkeley Computer Science Department
>