Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 19887D84C for ; Wed, 11 Jul 2012 02:40:44 +0000 (UTC) Received: (qmail 99733 invoked by uid 500); 11 Jul 2012 02:40:44 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 99429 invoked by uid 500); 11 Jul 2012 02:40:43 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 99402 invoked by uid 99); 11 Jul 2012 02:40:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Jul 2012 02:40:42 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of prabhu.flume@gmail.com designates 209.85.160.179 as permitted sender) Received: from [209.85.160.179] (HELO mail-gh0-f179.google.com) (209.85.160.179) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Jul 2012 02:40:35 +0000 Received: by ghbg24 with SMTP id g24so717299ghb.38 for ; Tue, 10 Jul 2012 19:40:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=EGKeWj2OzSn3Zna7Vp50sPUmpZXnmRUvd7CErELY8eU=; b=uwFJ3HjxneEVpF+nMgQuJT22CKhJreLsBZrvjPbh/ra1w2CpKruTH/2wSAc6Ew8pMF P5Iyp8AL2Y1Zed2C2USovO3DM5uLZjU0l3iOhv5xw39n9ZZv0VrlBOw27+ueunLzLozB aS3Ca0Y8MV6Idow35yrJCH8jjXCMqvxXhZPuTsdJALsN5SUC30ziRkFIXb9KBE3N1Xvt etZMEoMw41hz3pFSW2LnYEiyYwQyPXIkWGyzF8f9KXXVYzSN++OtMmGouDJJNDGQCUGR WCC5PRnVyinqJ84c9SYXgKk4lNJC/thICYsdu2v10rmQFd77xiKKoNgiF90XuJqU2djr Qp3Q== MIME-Version: 1.0 Received: by 10.50.42.165 with SMTP id p5mr13250624igl.68.1341974413319; Tue, 10 Jul 2012 19:40:13 -0700 (PDT) Received: by 10.64.95.163 with HTTP; Tue, 10 Jul 2012 19:40:13 -0700 (PDT) In-Reply-To: References: Date: Wed, 11 Jul 2012 08:10:13 +0530 Message-ID: Subject: Re: Flume - ng running issue From: prabhu k To: user@flume.apache.org Content-Type: multipart/alternative; boundary=14dae9340445341e8504c484c451 --14dae9340445341e8504c484c451 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable can you please anyone respond on the below issue? On Tue, Jul 10, 2012 at 6:39 PM, prabhu k wrote: > Hi, > > While i am executing flume-ng, i am getting following out put on my > terminal, it seems got struck. > > root@md-trngpoc1:/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSH= OT# > bin/flume-ng agent -n agent1 -c conf -f conf/agent1.conf > Info: Sourcing environment configuration script > /usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/conf/flume-env= .sh > Info: Including Hadoop libraries found via > (/usr/local/hadoop_dir/hadoop/bin/hadoop) for HDFS access > Info: Excluding > /usr/local/hadoop_dir/hadoop/libexec/../lib/slf4j-api-1.4.3.jar from > classpath > Info: Excluding > /usr/local/hadoop_dir/hadoop/libexec/../lib/slf4j-log4j12-1.4.3.jar from > classpath > + exec /usr/lib/jvm/java-6-sun-1.6.0.26/jre/bin/java -Xms100m -Xmx200m -c= p > '/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/conf:/usr/loc= al/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/lib/*:/usr/local/flume_d= ir/flume/flume-1.2.0-incubating-SNAPSHOT/conf:/usr/local/hadoop_dir/hadoop/= libexec/../conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/usr/local/hadoop_dir= /hadoop/libexec/..:/usr/local/hadoop_dir/hadoop/libexec/../hadoop-core-1.0.= 3.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/asm-3.2.jar:/usr/local/ha= doop_dir/hadoop/libexec/../lib/aspectjrt-1.6.5.jar:/usr/local/hadoop_dir/ha= doop/libexec/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop_dir/hadoop/lib= exec/../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop_dir/hadoop/libexe= c/../lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop_dir/hadoop/libe= xec/../lib/commons-cli-1.2.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/= commons-codec-1.4.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-c= ollections-3.2.1.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-co= nfiguration-1.6.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-dae= mon-1.0.1.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-digester-= 1.8.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-el-1.0.jar:/usr= /local/hadoop_dir/hadoop/libexec/../lib/commons-httpclient-3.0.1.jar:/usr/l= ocal/hadoop_dir/hadoop/libexec/../lib/commons-io-2.1.jar:/usr/local/hadoop_= dir/hadoop/libexec/../lib/commons-lang-2.4.jar:/usr/local/hadoop_dir/hadoop= /libexec/../lib/commons-logging-1.1.1.jar:/usr/local/hadoop_dir/hadoop/libe= xec/../lib/commons-logging-api-1.0.4.jar:/usr/local/hadoop_dir/hadoop/libex= ec/../lib/commons-math-2.1.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/= commons-net-1.4.1.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/core-3.1.= 1.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/hadoop-capacity-scheduler= -1.0.3.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/hadoop-fairscheduler= -1.0.3.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/hadoop-thriftfs-1.0.= 3.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/hsqldb-1.8.0.10.jar:/usr/= local/hadoop_dir/hadoop/libexec/../lib/jackson-core-asl-1.8.8.jar:/usr/loca= l/hadoop_dir/hadoop/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/usr/local/= hadoop_dir/hadoop/libexec/../lib/jasper-compiler-5.5.12.jar:/usr/local/hado= op_dir/hadoop/libexec/../lib/jasper-runtime-5.5.12.jar:/usr/local/hadoop_di= r/hadoop/libexec/../lib/jdeb-0.8.jar:/usr/local/hadoop_dir/hadoop/libexec/.= ./lib/jersey-core-1.8.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/jerse= y-json-1.8.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/jersey-server-1.= 8.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/jets3t-0.6.1.jar:/usr/loc= al/hadoop_dir/hadoop/libexec/../lib/jetty-6.1.26.jar:/usr/local/hadoop_dir/= hadoop/libexec/../lib/jetty-util-6.1.26.jar:/usr/local/hadoop_dir/hadoop/li= bexec/../lib/jsch-0.1.42.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/ju= nit-4.5.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/kfs-0.2.2.jar:/usr/= local/hadoop_dir/hadoop/libexec/../lib/log4j-1.2.15.jar:/usr/local/hadoop_d= ir/hadoop/libexec/../lib/mockito-all-1.8.5.jar:/usr/local/hadoop_dir/hadoop= /libexec/../lib/oro-2.0.8.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/s= ervlet-api-2.5-20081211.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/xml= enc-0.52.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/jsp-2.1/jsp-2.1.ja= r:/usr/local/hadoop_dir/hadoop/libexec/../lib/jsp-2.1/jsp-api-2.1.jar' > -Djava.library.path=3D/usr/local/flume_dir/flume/flume-1.2.0-incubating-S= NAPSHOT/lib:/usr/local/hadoop_dir/hadoop/libexec/../lib/native/Linux-i386-3= 2 > org.apache.flume.node.Application -n agent1 -f conf/agent1.conf > > in execution summary: > ---------------------------------------- > Info: Including Hadoop libraries found via > (/usr/local/hadoop_dir/hadoop/bin/hadoop) for HDFS access > > hadoop lib path pointing to /usr/local/hadoop_dir/hadoop/bin/hadoop > directory insted of /usr/local/hadoop_dir/hadoop/lib path. > > Here my questions are; > > 1. in flume-ng script anything changes need in add_hadoop_paths function. > 2. anything wrong in flume-env.sh script > 3. anything wrong in agent1.conf file. > > Please find the attached configuaration details and let me know any more > details. > > Could you pleae suggest me on this issue. > > Thanks, > Prabhu > > > --14dae9340445341e8504c484c451 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable can you please anyone respond on the below issue?

On Tue, Jul 10, 2012 at 6:39 PM, prabhu k <prabhu.flume@gmai= l.com> wrote:
Hi,
=A0
While i am executing flume-ng, i am getting following out put on my te= rminal, it seems got struck.

root@md-trngpoc1:/usr/local/= flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT# bin/flume-ng agent -n = agent1 -c conf -f conf/agent1.conf
Info: Sourcing environment configuration script /usr/local/flume_dir/flume/= flume-1.2.0-incubating-SNAPSHOT/conf/flume-env.sh
Info: Including Hadoop= libraries found via (/usr/local/hadoop_dir/hadoop/bin/hadoop) for HDFS acc= ess
Info: Excluding /usr/local/hadoop_dir/hadoop/libexec/../lib/slf4j-api-1.4.3= .jar from classpath
Info: Excluding /usr/local/hadoop_dir/hadoop/libexec= /../lib/slf4j-log4j12-1.4.3.jar from classpath
+ exec /usr/lib/jvm/java-= 6-sun-1.6.0.26/jre/bin/java -Xms100m -Xmx200m -cp '/usr/local/flume_dir= /flume/flume-1.2.0-incubating-SNAPSHOT/conf:/usr/local/flume_dir/flume/flum= e-1.2.0-incubating-SNAPSHOT/lib/*:/usr/local/flume_dir/flume/flume-1.2.0-in= cubating-SNAPSHOT/conf:/usr/local/hadoop_dir/hadoop/libexec/../conf:/usr/li= b/jvm/java-6-sun/lib/tools.jar:/usr/local/hadoop_dir/hadoop/libexec/..:/usr= /local/hadoop_dir/hadoop/libexec/../hadoop-core-1.0.3.jar:/usr/local/hadoop= _dir/hadoop/libexec/../lib/asm-3.2.jar:/usr/local/hadoop_dir/hadoop/libexec= /../lib/aspectjrt-1.6.5.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/asp= ectjtools-1.6.5.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-bea= nutils-1.7.0.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-beanut= ils-core-1.8.0.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-cli-= 1.2.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-codec-1.4.jar:/= usr/local/hadoop_dir/hadoop/libexec/../lib/commons-collections-3.2.1.jar:/u= sr/local/hadoop_dir/hadoop/libexec/../lib/commons-configuration-1.6.jar:/us= r/local/hadoop_dir/hadoop/libexec/../lib/commons-daemon-1.0.1.jar:/usr/loca= l/hadoop_dir/hadoop/libexec/../lib/commons-digester-1.8.jar:/usr/local/hado= op_dir/hadoop/libexec/../lib/commons-el-1.0.jar:/usr/local/hadoop_dir/hadoo= p/libexec/../lib/commons-httpclient-3.0.1.jar:/usr/local/hadoop_dir/hadoop/= libexec/../lib/commons-io-2.1.jar:/usr/local/hadoop_dir/hadoop/libexec/../l= ib/commons-lang-2.4.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons= -logging-1.1.1.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-logg= ing-api-1.0.4.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-math-= 2.1.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/commons-net-1.4.1.jar:/= usr/local/hadoop_dir/hadoop/libexec/../lib/core-3.1.1.jar:/usr/local/hadoop= _dir/hadoop/libexec/../lib/hadoop-capacity-scheduler-1.0.3.jar:/usr/local/h= adoop_dir/hadoop/libexec/../lib/hadoop-fairscheduler-1.0.3.jar:/usr/local/h= adoop_dir/hadoop/libexec/../lib/hadoop-thriftfs-1.0.3.jar:/usr/local/hadoop= _dir/hadoop/libexec/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop_dir/hadoop= /libexec/../lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop_dir/hadoop/lib= exec/../lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop_dir/hadoop/libex= ec/../lib/jasper-compiler-5.5.12.jar:/usr/local/hadoop_dir/hadoop/libexec/.= ./lib/jasper-runtime-5.5.12.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib= /jdeb-0.8.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/jersey-core-1.8.j= ar:/usr/local/hadoop_dir/hadoop/libexec/../lib/jersey-json-1.8.jar:/usr/loc= al/hadoop_dir/hadoop/libexec/../lib/jersey-server-1.8.jar:/usr/local/hadoop= _dir/hadoop/libexec/../lib/jets3t-0.6.1.jar:/usr/local/hadoop_dir/hadoop/li= bexec/../lib/jetty-6.1.26.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/j= etty-util-6.1.26.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/jsch-0.1.4= 2.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/junit-4.5.jar:/usr/local/= hadoop_dir/hadoop/libexec/../lib/kfs-0.2.2.jar:/usr/local/hadoop_dir/hadoop= /libexec/../lib/log4j-1.2.15.jar:/usr/local/hadoop_dir/hadoop/libexec/../li= b/mockito-all-1.8.5.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/oro-2.0= .8.jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/servlet-api-2.5-20081211= .jar:/usr/local/hadoop_dir/hadoop/libexec/../lib/xmlenc-0.52.jar:/usr/local= /hadoop_dir/hadoop/libexec/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop_dir= /hadoop/libexec/../lib/jsp-2.1/jsp-api-2.1.jar' -Djava.library.path=3D/= usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/lib:/usr/local/ha= doop_dir/hadoop/libexec/../lib/native/Linux-i386-32 org.apache.flume.node.A= pplication -n agent1 -f conf/agent1.conf

in execution summary:
----------------------------------------
Info: Including Hadoop libraries found via (/usr/local/hadoop_dir/hado= op/bin/hadoop) for HDFS access
=A0
hadoop lib path pointing to /usr/local/hadoop_dir/hadoop/bin/hadoop di= rectory insted of /usr/local/hadoop_dir/hadoop/lib path.
=A0
Here my questions are;
=A0
1. in flume-ng script anything changes need in add_hadoop_paths functi= on.
2. anything wrong in flume-env.sh script
3. anything wrong in age= nt1.conf file.
=A0
Please find the attached configuaration details and let me know any mo= re details.
=A0
Could you pleae suggest me on this issue.
=A0
Thanks,
Prabhu

=A0


--14dae9340445341e8504c484c451--