Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 69C4CD2DC for ; Mon, 20 May 2013 12:10:49 +0000 (UTC) Received: (qmail 24681 invoked by uid 500); 20 May 2013 12:10:44 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 24128 invoked by uid 500); 20 May 2013 12:10:41 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 24087 invoked by uid 99); 20 May 2013 12:10:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 May 2013 12:10:39 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE X-Spam-Check-By: apache.org Received-SPF: error (nike.apache.org: local policy) Received: from [106.10.151.17] (HELO nm22.bullet.mail.sg3.yahoo.com) (106.10.151.17) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 20 May 2013 12:10:31 +0000 Received: from [106.10.166.117] by nm22.bullet.mail.sg3.yahoo.com with NNFMP; 20 May 2013 12:09:46 -0000 Received: from [106.10.151.219] by tm6.bullet.mail.sg3.yahoo.com with NNFMP; 20 May 2013 12:09:46 -0000 Received: from [127.0.0.1] by omp1017.mail.sg3.yahoo.com with NNFMP; 20 May 2013 12:09:46 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 233686.45670.bm@omp1017.mail.sg3.yahoo.com Received: (qmail 41897 invoked by uid 60001); 20 May 2013 12:09:46 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.in; s=s1024; t=1369051785; bh=810FxyGVyN37leyhEI85YwiPDjMLfClmVVt8bjtdHdI=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=c8AKtuFLo+ANkdol6Lim6Y/EI8ZCLVNR2Vd2dHfNUzAENSCHxYhjaW69OV5mSH1Pn+hzDGeVjzg+2O2mD1wETG0xAVykMkk8gBUYDEkWIXFX++z0OcV0TprId2yAVXM/RXqoqccYxEiAKgGCdcjBeghXuZ3AeKxa9jppqe/zTXw= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.in; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=6u0PWwNoom22vEEBw+2cx5BYdcIdxkkT61t56oPSm0bq2SNTMUo3ScHjCRXPKpa9dB/smo3Slz2nd3YsSbKSTC57OyRtkKfqGdQV19uSYq3RMkHNOk/6DVU08agbHKLAUEBM0MUI3/9G7sq45kJ3BwuzKUwOc3maX+R5dCReVZk=; X-YMail-OSG: kAnm5q0VM1nReULApWle.RjEIoedfUDkhj7Lh7L160X9SqL HBY3KfX4dCQVYID_IEB4B.ceY2ot3Gu87.BPKu7L_vAhbQNIdd249P_LzFLr OIjllfvxm393MQezDPbJ.CsoMUCWuqW3ojNRdK.Rkd91qOymKae4De_ebzf0 1.wXKaZv6n4Pd1ussoLycvWpEEBDgB2H8AnxuZBgnoU_xub_ntGcH7YOxBgJ TjmovmB3dx.Btw3w2ZC.d18Sz4jZyJZdCm15xGXIDa9eybIkvjmmDmVv_fw2 6aHcmcQm1XmIO2yfFmxeYHjaT.hHq50bjmqgWt9Puan0YwBj7yRYbD9TIaaF IL3dDNp9WKP3XGofS3151YHGQXielk9wSRIBhw7Q86qqLxspHs.sKNjwKdfE 5UFxVQNrnRegIW_nS7vc5xASSNxum8mkWLoXMrNEW7XXfUaoR15Dbo.M9QPU DMlg.6SRGA1y4DYvjUloBkDpSoVdxeFBF5DPjYJrV Received: from [49.204.46.95] by web190703.mail.sg3.yahoo.com via HTTP; Mon, 20 May 2013 20:09:45 SGT X-Rocket-MIMEInfo: 002.001,Tm90IHN1cmUgaWYgdGhpcyBpcyB0aGUgcmlnaHQgZ3JvdXAgdG8gYXNrIHF1ZXN0aW9ucyBhYm91dCBmbHVtZToKCkkgYW0gZ2V0dGluZyBhbiBleGNlcHRpb24gYWJvdXQgdW5hYmxlIHRvIG9wZW4gYSBwb3J0IGluIGZsdW1lIHdoZW4gdHJ5aW5nIHRvIGNyZWF0ZSBhIHJlbW90ZSBhZ2VudCwgbW9yZSBkZXRhaWxzIGJlbG93OgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KMTMvMDUvMjAgMDQ6NTU6MzAgRVJST1IgYXZyby5BdnJvQ0xJQ2xpZW50OiBVbmFibGUgdG8gb3BlbiBjb25uZWN0aW9uIHRvIEYBMAEBAQE- X-Mailer: YahooMailWebService/0.8.142.542 References: <1364377874.13753.YahooMailNeo@web194703.mail.sg3.yahoo.com> <1364577771.12724.YahooMailNeo@web194704.mail.sg3.yahoo.com> <1364719534.91394.YahooMailNeo@web194703.mail.sg3.yahoo.com> <1365042870.89547.YahooMailNeo@web194702.mail.sg3.yahoo.com> <1365740112.75877.YahooMailNeo@web190702.mail.sg3.yahoo.com> <578478094-1365742754-cardhu_decombobulator_blackberry.rim.net-2001349931-@b16.c6.bise7.blackberry> <1365754060.82642.YahooMailNeo@web190701.mail.sg3.yahoo.com> <1365817528.61054.YahooMailNeo@web190703.mail.sg3.yahoo.com> <0DBEF640-2DAE-448B-8F3A-A6D59DCEE3D6@123.org> <1365818346.16517.YahooMailNeo@web190701.mail.sg3.yahoo.com> Message-ID: <1369051785.39508.YahooMailNeo@web190703.mail.sg3.yahoo.com> Date: Mon, 20 May 2013 20:09:45 +0800 (SGT) From: Sai Sai Reply-To: Sai Sai Subject: Re: Flume port issue To: "user@hadoop.apache.org" In-Reply-To: <1365818346.16517.YahooMailNeo@web190701.mail.sg3.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="-300775223-1513913395-1369051785=:39508" X-Virus-Checked: Checked by ClamAV on apache.org ---300775223-1513913395-1369051785=:39508 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Not sure if this is the right group to ask questions about flume:=0A=0AI am= getting an exception about unable to open a port in flume when trying to c= reate a remote agent, more details below:=0A---------------------------=0A1= 3/05/20 04:55:30 ERROR avro.AvroCLIClient: Unable to open connection to Flu= me. Exception follows.=0Aorg.apache.flume.FlumeException: NettyAvroRpcClien= t { host: ubuntu, port: 41414 }: RPC connection error=0A-------------------= --------=0A=0A=0AHere r the steps i have followed:=0A=0AStep 1: Here is my = agent3.conf created in the flume/conf dir:=0A=0A******=0Aagent3.sources =3D= avrosource=0Aagent3.sinks =3D filesink=0Aagent3.channels =3D jdbcchannel= =0A=0Aagent3.sources.avrosource.type =3D avro=0Aagent3.sources.avrosource.b= ind =3D localhost=0Aagent3.sources.avrosource.port =3D 4000=0Aagent3.source= s.avrosource.threads =3D 5=0A=0Aagent3.sinks.filesink.type =3D FILE_ROLL=0A= agent3.sinks.filesink.sink.directory =3D /home/satish/work/apache-flume-1.3= .1-bin/files=0Aagent3.sinks.filesink.sink.rollInterval =3D 0=0A=0Aagent3.ch= annels.jdbcchannel.type =3D jdbc=0A=0Aagent3.sources.avrosource.channels = =3D jdbcchannel=0Aagent3.sinks.filesink.channel =3D jdbcchannel=0A=0A******= =0A=0A=0AStep 2: Then i have saved it successfully and created a new test f= ile like this:=0A=0AStep 3: echo "Hello World" > /home/satish/message3=0A= =0AStep 4: Tried executing this command:=0A=0A./flume-ng avro-client -H loc= alhost -p 4000 -F /home/satish/message3=0A=0AI get this exception below, pl= ease help:=0A=0A------------------------------=0A=0ADjava.library.path=3D:/= home/satish/work/hadoop-1.0.4/libexec/../lib/native/Linux-i386-32 org.apach= e.flume.client.avro.AvroCLIClient -H ubuntu -p 41414 -F /usr/logs/log.10=0A= 13/05/20 04:55:30 ERROR avro.AvroCLIClient: Unable to open connection to Fl= ume. Exception follows.=0Aorg.apache.flume.FlumeException: NettyAvroRpcClie= nt { host: ubuntu, port: 41414 }: RPC connection error=0Aat org.apache.flum= e.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:117)=0Aat org.apac= he.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClient.java:93)=0Aat or= g.apache.flume.api.NettyAvroRpcClient.configure(NettyAvroRpcClient.java:507= )=0Aat org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFa= ctory.java:169)=0Aat org.apache.flume.client.avro.AvroCLIClient.run(AvroCLI= Client.java:180)=0Aat org.apache.flume.client.avro.AvroCLIClient.main(AvroC= LIClient.java:71)=0ACaused by: java.io.IOException: Error connecting to ubu= ntu/127.0.0.1:41414=0Aat org.apache.avro.ipc.NettyTransceiver.getChannel(Ne= ttyTransceiver.java:261)=0Aat org.apache.avro.ipc.NettyTransceiver.(N= ettyTransceiver.java:203)=0Aat org.apache.avro.ipc.NettyTransceiver.(= NettyTransceiver.java:152)=0Aat org.apache.flume.api.NettyAvroRpcClient.con= nect(NettyAvroRpcClient.java:106)=0A... 5 more=0ACaused by: java.net.Connec= tException: Connection refused=0Aat sun.nio.ch.SocketChannelImpl.checkConne= ct(Native Method)=0Aat sun.nio.ch.SocketChannelImpl.finishConnect(SocketCha= nnelImpl.java:592)=0Aat org.jboss.netty.channel.socket.nio.NioClientSocketP= ipelineSink$Boss.connect(NioClientSocketPipelineSink.java:396)=0Aat org.jbo= ss.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelecte= dKeys(NioClientSocketPipelineSink.java:358)=0Aat org.jboss.netty.channel.so= cket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.j= ava:274)=0Aat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolE= xecutor.java:1110)=0Aat java.util.concurrent.ThreadPoolExecutor$Worker.run(= ThreadPoolExecutor.java:603)=0Aat java.lang.Thread.run(Thread.java:679)=0A= =0A=0APlease help.=0AThanks=0ASai ---300775223-1513913395-1369051785=:39508 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Not s= ure if this is the right group to ask questions about flume:

I am getting an exception about unable to ope= n a port in flume when trying to create a remote agent, more details below:=
---------------------------
13/05/20 04:5= 5:30 ERROR avro.AvroCLIClient: Unable to open connection to Flume. Exceptio= n follows.
org.apache.flume.FlumeException: NettyAvroRpcClient { h= ost: ubuntu, port: 41414 }: RPC connection error
----------------= -----------

Here r the steps i have followed:<= /div>

Step 1: Here is my agent3.conf created in the flume/conf= dir:

******
agent3.sources =3D avrosource
agent3.sinks =3D filesink
=
agent3.channels =3D jdbcchannel<= /div>

agent3.sources.avrosource.type =3D avro
agent3.sources.avrosourc= e.bind =3D localhost
ag= ent3.sources.avrosource.port =3D 4000
agent3.sources.avrosource.threads =3D 5

agent3.sinks.filesink.type =3D FILE_ROLL
agent3.sinks.filesink.sink.directory =3D /h= ome/satish/work/apache-flume-1.3.1-bin/files
agent3.sinks.filesink.sink.rollInterval =3D 0

agent3.channels.jdbcchannel.type =3D jdbc

agent3.sources.avrosource.channels =3D jdbcchannel
agent3.sinks.filesink.channel =3D jdbcchann= el


Step 2: Then i have = saved it successfully and created a new test file like this:

Step 3: echo "Hello World" > /home/satis= h/message3

Step 4: Tried executing= this command:

./flu= me-ng avro-client -H localhost -p 4000 -F /home/satish/message3

I= get this exception below, please help:

------------------------------

Djava.library.= path=3D:/home/satish/work/hadoop-1.0.4/libexec/../lib/native/Linux-i386-32 = org.apache.flume.client.avro.AvroCLIClient -H ubuntu -p 41414 -F /usr/logs/= log.10
13/05/20 04:55:30 ERROR avro.AvroCLIClient: Unable to open= connection to Flume. Exception follows.
org.apache.flume.FlumeEx= ception: NettyAvroRpcClient { host: ubuntu, port: 41414 }: RPC connection e= rror
=09= at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroRpcClien= t.java:117)
=09at org.apache.flume.api.NettyAvroRpcClient.connect(NettyAvroR= pcClient.java:93)
=09at org.apache.flume.api.NettyAvroRpcClient.configure(NettyAvroRpc= Client.java:507)
=09at org.apache.flume.api.RpcClientFactory.getDefaultInsta= nce(RpcClientFactory.java:169)
=09at org.apache.flume.client.avro.AvroCLICli= ent.run(AvroCLIClient.java:180)
=09at org.apache.flume.client.avro.AvroCLICl= ient.main(AvroCLIClient.java:71)
Caused by: java.io.IOException: = Error connecting to ubuntu/127.0.0.1:41414
=09at org.apache.avro.ipc.NettyTr= ansceiver.getChannel(NettyTransceiver.java:261)
=09at org.apache.avro.ipc.Ne= ttyTransceiver.<init>(NettyTransceiver.java:203)
=09at org.apache.avro.ipc.NettyTransceive= r.<init>(NettyTransceiver.java:152)
=09at org.apache.flume.api.NettyAv= roRpcClient.connect(NettyAvroRpcClient.java:106)
=09... 5 more
Cau= sed by: java.net.ConnectException: Connection refused
=09at sun.nio.ch.Socke= tChannelImpl.checkConnect(Native Method)
=09at sun.nio.ch.SocketChannelImpl.= finishConnect(SocketChannelImpl.java:592)
=09at org.jboss.netty.channel.sock= et.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink= .java:396)
=09at org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.proces= sSelectedKeys(NioClientSocketPipelineSink.java:358)
=09at org.jboss.netty.= channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipe= lineSink.java:274)
=09at java.util.concurrent.ThreadPoolExecutor.runWorker(T= hreadPoolExecutor.java:1110)
=09at java.util.concurrent.ThreadPoolExecutor$W= orker.run(ThreadPoolExecutor.java:603)
=09at java.lang.Thread.run(Thread.jav= a:679)


Please help.
Thanks
Sai




---300775223-1513913395-1369051785=:39508--