Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of billgraham@gmail.com
 designates 74.125.82.175 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:reply-to:in-reply-to:references:date:message-id
         :subject:from:to:content-type:content-transfer-encoding;
        b=MM184umqmiSRTKA7vuBVbvhEdnbAjR+RaLDBSMStZ7o/ACi8WFTpDtkXgYW5p8ZbRN
         rOUugS5LZFZPqLehReutuBypv1YMtsWDMODrW1bi8BcJVl3HP5dBBW1qnGDwYD/iPOtn
         tQgKkjcR5nv1ixn8HwL7rVO5roJZufeBejlME=
MIME-Version: 1.0
Reply-To: billgraham@gmail.com
In-Reply-To: 
 <14B8F27D7CE40C4C9E481B2B845C2E0D069FA9D2E4@EXCHANGE.persistent.co.in>
References: <201009061303101097855@neusoft.com>
	<00ef01cb4db9$bec65ab0$3c531010$@com>
	<AANLkTinx=mV0Q2icbrd6yyVR5DOpubgfBdVrJjWdLqfS@mail.gmail.com>
	<4C858BBB.8010901@neusoft.com>
	<AANLkTimn=gXa8ku3ZR19LvBGnsnXD4az4MBUQ2Lt0M_9@mail.gmail.com>
	<4C85F7C6.5090609@neusoft.com>
	<14B8F27D7CE40C4C9E481B2B845C2E0D069FA9D2E4@EXCHANGE.persistent.co.in>
Date: Wed, 8 Sep 2010 08:34:44 -0700
Message-ID: <AANLkTimf7GSAK=hLRjUaQeDv5iuZs0TW6R=oc4qpVckz@mail.gmail.com>
Subject: Re: setting collector on a remote machine
From: Bill Graham <billgraham@gmail.com>
To: "chukwa-user@incubator.apache.org" <chukwa-user@incubator.apache.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Yes, you can run the collector on any host with network access to
HDFS. Verify that HADOOP_HOME and HADOOP_CONF_DIR are properly set in
chukwa-env.sh. Also verify that you can connect to hadoop from the
command line with those environment variables set.

On Tuesday, September 7, 2010, Shreya Chakravarty
<shreya_chakravarty@persistent.co.in> wrote:
> Hi,
>
> We want to setup a collector on a non HDFS machine
> Is that possible? Will the collector be able to send data to hdfs, we tri=
ed setting the writer.hdfs.filesystem property to point to the hdfs master,=
 but getting the following error:
>
>
> 2010-09-07 05:53:11,153 INFO main ChukwaConfiguration - chukwaConf is /ho=
me/hadoop/chukwa-0.4.0/conf/
> 2010-09-07 05:53:12,721 INFO main root - initing servletCollector
> 2010-09-07 05:53:12,727 INFO main PipelineStageWriter - using pipelined w=
riters, pipe length is 2
> 2010-09-07 05:53:12,751 INFO Thread-9 SocketTeeWriter - listen thread sta=
rted
> 2010-09-07 05:53:12,755 INFO main SeqFileWriter - rotateInterval is 30000=
0
> 2010-09-07 05:53:12,755 INFO main SeqFileWriter - outputDir is /chukwa/lo=
gs/
> 2010-09-07 05:53:12,755 INFO main SeqFileWriter - fsname is iaas-1-0-16-3=
e-b7-d1-29:54310
> 2010-09-07 05:53:12,756 INFO main SeqFileWriter - filesystem type from co=
re-default.xml is org.apache.hadoop.hdfs.DistributedFileSystem
> 2010-09-07 05:53:12,860 ERROR main SeqFileWriter - can't connect to HDFS,=
 trying default file system instead (likely to be local)
> java.io.IOException: No FileSystem for scheme: iaas-1-0-16-3e-b7-d1-29
>  =A0 =A0 =A0 =A0at org.apache.hadoop.fs.FileSystem.createFileSystem(FileS=
ystem.java:1375)
>  =A0 =A0 =A0 =A0at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.=
java:66)
>  =A0 =A0 =A0 =A0at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.j=
ava:1390)
>  =A0 =A0 =A0 =A0at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:19=
6)
>  =A0 =A0 =A0 =A0at org.apache.hadoop.chukwa.datacollection.writer.SeqFile=
Writer.init(SeqFileWriter.java:123)
>  =A0 =A0 =A0 =A0at org.apache.hadoop.chukwa.datacollection.writer.Pipelin=
eStageWriter.init(PipelineStageWriter.java:88)
>  =A0 =A0 =A0 =A0at org.apache.hadoop.chukwa.datacollection.collector.serv=
let.ServletCollector.init(ServletCollector.java:112)
>  =A0 =A0 =A0 =A0at org.mortbay.jetty.servlet.ServletHolder.initServlet(Se=
rvletHolder.java:440)
>  =A0 =A0 =A0 =A0at org.mortbay.jetty.servlet.ServletHolder.doStart(Servle=
tHolder.java:263)
>  =A0 =A0 =A0 =A0at org.mortbay.component.AbstractLifeCycle.start(Abstract=
LifeCycle.java:50)
>  =A0 =A0 =A0 =A0at org.mortbay.jetty.servlet.ServletHandler.initialize(Se=
rvletHandler.java:685)
>  =A0 =A0 =A0 =A0at org.mortbay.jetty.servlet.Context.startContext(Context=
.java:140)
>  =A0 =A0 =A0 =A0at org.mortbay.jetty.handler.ContextHandler.doStart(Conte=
xtHandler.java:517)
>  =A0 =A0 =A0 =A0at org.mortbay.component.AbstractLifeCycle.start(Abstract=
LifeCycle.java:50)
>  =A0 =A0 =A0 =A0at org.mortbay.jetty.handler.HandlerWrapper.doStart(Handl=
erWrapper.java:130)
>  =A0 =A0 =A0 =A0at org.mortbay.jetty.Server.doStart(Server.java:224)
>  =A0 =A0 =A0 =A0at org.mortbay.component.AbstractLifeCycle.start(Abstract=
LifeCycle.java:50)
>  =A0 =A0 =A0 =A0at org.apache.hadoop.chukwa.datacollection.collector.Coll=
ectorStub.main(CollectorStub.java:121)
>
> Regards
> Shreya
>
> DISCLAIMER
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> This e-mail may contain privileged and confidential information which is =
the property of Persistent Systems Ltd. It is intended only for the use of =
the individual or entity to which it is addressed. If you are not the inten=
ded recipient, you are not authorized to read, retain, copy, print, distrib=
ute or use this message. If you have received this communication in error, =
please notify the sender and delete all copies of this message. Persistent =
Systems Ltd. does not accept any liability for virus infected mails.
>