Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of dontariq@gmail.com designates
 209.85.161.47 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAB-acjOtn5=Ef+WzTMR_2Rg=55p4Q21E9ic_BxfDtbf4DwEm3A@mail.gmail.com>
References: 
 <CAMVC6RN1U=8PfJFVeyf4pyc6G=H9W7Po16CRSCmetBtu2B_=Eg@mail.gmail.com>
 <CANZWjw4zxKyt7iw1B=-egMtA5syseGMjGy1zn=d4C8xz6X-mEQ@mail.gmail.com>
 <CAMVC6RO8__fa97j1kztpfYRw_DzyyP9RyWX+C=6wauAb3K9YBw@mail.gmail.com>
 <CANZWjw79j7czk88k-GKaTS=_tqo3x=XD2VaWqBQyxNA1xJ9F+g@mail.gmail.com>
 <CAB-acjOtn5=Ef+WzTMR_2Rg=55p4Q21E9ic_BxfDtbf4DwEm3A@mail.gmail.com>
From: Mohammad Tariq <dontariq@gmail.com>
Date: Thu, 10 Nov 2011 18:43:20 +0530
Message-ID: 
 <CAMVC6RPf78=V6j86diwNTmQ9cu=bbxwVwOBBgKKrAKoUaqsdyg@mail.gmail.com>
Subject: Re: How to begin with Chukwa
To: chukwa-user@incubator.apache.org, billgraham@gmail.com
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hello AD,
   I am sorry for leaving the discussion in between, I was busy with
my exams.Now I am back and need your help.I started with what you have
suggested and read about the concepts (agents and collectors etc). Now
I am trying to collect the data from a file on the local file system
and trying to dump it into the HDFS and I am running the agent and
collector on the same machine.I was able to start the agent but when I
tried to start the collector I got the following line at the terminal
and the terminal got stuck there itself -
tariq@ubuntu:~/chukwa-0.4.0$ 2011-11-10 18:42:09.521::INFO:  Logging
to STDERR via org.mortbay.log.StdErrLog
2011-11-10 18:42:09.544::INFO:  jetty-6.1.11

When I issued jps, I could see only the agent.

Regards,
=A0=A0 =A0Mohammad Tariq


On Sat, Nov 5, 2011 at 5:38 AM, Bill Graham <billgraham@gmail.com> wrote:
> One difference between Chukwa and Flume is that in Chukwa you configure e=
ach
> component individually to know how to handle different datatypes. This ma=
kes
> it fairly straight-forward to set up, but can be painful to manage for ve=
ry
> large installs (so I've heard). Flume centralized the configs of "flows"
> which helps when managing larger installs, at the cost of additional
> complexity.
>
> On Fri, Nov 4, 2011 at 7:02 AM, AD <straightflush@gmail.com> wrote:
>>
>> Are you running the agent and collector on the same machine? =A0Off the =
cuff
>> its something like
>> 1 - set your CHUKWA_HOME env variable
>> 2 - edit conf/chukwa-env.sh and make sure JAVA_HOME and all the vars loo=
k
>> good
>> 3 - edit conf/initial_adaptors with the adaptors you need. =A0note here =
that
>> the dataType
>> 4 - edit conf/collectors and add the hostname/ip of the collectors
>> 5 - edit conf/agents and add ip/hostname of the agents
>> 6 - edit conf/chukwa-demux.conf and make sure you have a demux processor
>> for your dataType (name from initial_adaptors)
>> On agent node run bin/chukwa agent , tail ${CHUKWA_LOGS}/agent.log
>> On collector node run bin/chukwa collector =A0, =A0tail
>> ${CHUKWA_LOGS]/collector.log
>> On collector node run bin/chukwa Demux =A0, =A0tail ${CHUKWA_LOGS}/Demux=
.log
>>
>>
>> On Fri, Nov 4, 2011 at 9:48 AM, Mohammad Tariq <dontariq@gmail.com> wrot=
e:
>>>
>>> Hello AD,
>>> =A0 Yes, I have read the wiki and right now I am trying to set up a
>>> Chukwa cluster using the wiki itself. Are there any other links you
>>> are aware of that can help me learn and use Chukwa in a better
>>> fashion?? I am trying to use Chukwa for data in=A0"The Wellsite
>>> Information Transfer Standard Markup Language (WITSML)" format.
>>>
>>> Regards,
>>> =A0=A0 =A0Mohammad Tariq
>>>
>>>
>>> On Fri, Nov 4, 2011 at 6:49 PM, AD <straightflush@gmail.com> wrote:
>>> >
>>> > I think it helps to read he wiki and understand the basic concepts,
>>> > like agents and collectors. =A0What kind of data do you want to parse=
? =A0I have
>>> > used both Flume and Chukwa myself and can say for sure Chukwa is mile=
s
>>> > easier to work with and configure. =A0Flume may have some more advanc=
ed
>>> > features, but so far i found Chukwa both easy to extend from a develo=
pment
>>> > standpoint, and much easier to configure.
>>> > Have you read the wiki pages ?
>>> >
>>> > On Fri, Nov 4, 2011 at 8:39 AM, Mohammad Tariq <dontariq@gmail.com>
>>> > wrote:
>>> >>
>>> >> Hello list,
>>> >> =A0 I am totally new to Chukwa and I have to learn and start using i=
t as
>>> >> soon soon as possible as a part of my new project. Could any one let=
 me know
>>> >> how to begin with?? It would be a great favor to me. I know Flume an=
d have
>>> >> used it already.Also I would like to know how different is Chukwa fr=
om
>>> >> Flume??
>>> >> =A0 Many thanks in advance.
>>> >>
>>> >> =A0 Regards,
>>> >> =A0=A0 =A0Mohammad Tariq
>>> >
>>
>
>