Mailing-List: contact flume-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: flume-user@incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of ankul.rastogi@gmail.com
 designates 209.85.220.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CADXBggczh+dFoom0RntGW_J+jOFidfNze7kmtuAvWF0NucY3Tw@mail.gmail.com>
References: 
 <CABye6yzCToBYVyNfsEFfc5ux8YtfFpdFgo8bgFhu7NsquTGQew@mail.gmail.com>
	<CABye6yyCSwwq8Gs6_hBwUoPZQQKqjQ5T67p_41QN1+P5t8m3YA@mail.gmail.com>
	<09887E962F0C459CB262E02206865AFD@cloudera.com>
	<CABye6ywj-sEVXcsZospLMTeBMpYHjJfLHEDdR3Ch693qy7PMCw@mail.gmail.com>
	<CADXBggeZr+vd70LZm_-H2oN9SwfobTSE9LZBZdhJsHzvQECTEg@mail.gmail.com>
	<369264018DE245BD9558970441133E4B@cloudera.com>
	<CABye6yyMpzuK33qQeP9FWCi-Bqt3wBZKtF4arHDDNF4j-sBsiw@mail.gmail.com>
	<1142A67B2FD34FE9835368D6815CD69B@cloudera.com>
	<CABye6yxFj+J=Djx=8nCaNXBwO8rbgxiuhaTLDcx44WPGUKqung@mail.gmail.com>
	<045663933B2A446B8C59EA10130445C4@cloudera.com>
	<CABye6yz=7LkH8_tW8+-5u-SHVa=PD_Gw2r5SFounCK9uwRfpYg@mail.gmail.com>
	<CADXBggczh+dFoom0RntGW_J+jOFidfNze7kmtuAvWF0NucY3Tw@mail.gmail.com>
Date: Tue, 3 Jul 2012 23:19:56 +0530
Message-ID: 
 <CAPvE9Jj2PtfsU00H7xQxn+DwqwBCE5i3vaxj00FbcqWS3Jg5tQ@mail.gmail.com>
Subject: Re: Flume agent failure
From: ankul rastogi <ankul.rastogi@gmail.com>
To: flume-user@incubator.apache.org
Content-Type: multipart/alternative; boundary=20cf3071c874de86cf04c3f08a75

--20cf3071c874de86cf04c3f08a75
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I had the same problem.
The quick solution that worked for me was to copy the *hadoop-core-1.0.3.jar
* to <flume-installation>/lib folder*. *You can find this jar in your
hadoop installation directory.

On Tue, Jul 3, 2012 at 10:14 PM, Mike Percy <mpercy@cloudera.com> wrote:

> On Mon, Jul 2, 2012 at 12:11 AM, vijay k <k.vijay52@gmail.com> wrote:
>
>>
>>
>> root@md-trngpoc1:/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT#
>> bin/flume-ng agent -n agent1 -c conf -f conf/agent1.conf
>> Info: Sourcing environment configuration script
>> /usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/conf/flume-env.sh
>> Info: Including Hadoop libraries found via (/usr/local/hadoop/bin/hadoop)
>> for HDFS access
>> + exec /usr/lib/jvm/java-6-sun-1.6.0.26/jre/bin/java -Xms100m -Xmx200m
>> -cp
>> '/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/conf:/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/lib/*:/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/conf'
>> -Djava.library.path=:/usr/local/hadoop/bin/../lib/native/Linux-i386-32
>> org.apache.flume.node.Application -n agent1 -f conf/agent1.conf
>>
>
> This is really strange. Your java.library.path is set to
> /usr/local/hadoop/lib/native/Linux-i386-32 but for some reason the output
> of "hadoop classpath" has not made it into your classpath. I've never seen
> that combination before - usually both are there or both are missing.
> That's because the same hadoop binary is used for both cases. Are you on a
> 32-bit OS? I don't know if anyone has ever tested Flume on a 32-bit OS.
>
> If you can post the output of the following 6 commands, it might give us
> more to go on:
>
> which hadoop
> echo $HADOOP_HOME
> hadoop classpath
> which java
> echo $JAVA_HOME
> java -version
>
> If you are fluent in shell scripting, you can also trace the bin/flume-ng
> script and see where it's going wrong. Or just invoke it as:
>
>   bash -x bin/flume-ng agent -n agent1 -c conf -f conf/agent1.conf
>
> And post the output of that as well (it will be quite long).
>
> Regards,
> Mike
>
>

--20cf3071c874de86cf04c3f08a75
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi,<div><br></div><div>I had the same problem.=A0</div><div>The quick solut=
ion that worked for me was to copy the <b>hadoop-core-1.0.3.jar </b>=A0to &=
lt;flume-installation&gt;/lib folder<b>. </b>You can find this jar in your =
hadoop installation directory.<br>
<br><div class=3D"gmail_quote">On Tue, Jul 3, 2012 at 10:14 PM, Mike Percy =
<span dir=3D"ltr">&lt;<a href=3D"mailto:mpercy@cloudera.com" target=3D"_bla=
nk">mpercy@cloudera.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail=
_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:=
1ex">
<div class=3D"im">On Mon, Jul 2, 2012 at 12:11 AM, vijay k <span dir=3D"ltr=
">&lt;<a href=3D"mailto:k.vijay52@gmail.com" target=3D"_blank">k.vijay52@gm=
ail.com</a>&gt;</span> wrote:<br></div><div class=3D"gmail_quote"><div clas=
s=3D"im">
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">

<div>=A0</div>
<div><div><a href=3D"mailto:root@md-trngpoc1:/usr/local/flume_dir/flume/flu=
me-1.2.0-incubating-SNAPSHOT" target=3D"_blank">root@md-trngpoc1:/usr/local=
/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT</a>#=A0 bin/flume-ng agent=
 -n agent1 -c conf -f conf/agent1.conf<br>


Info: Sourcing environment configuration script /usr/local/flume_dir/flume/=
flume-1.2.0-incubating-SNAPSHOT/conf/flume-env.sh<br></div>Info: Including =
Hadoop libraries found via (/usr/local/hadoop/bin/hadoop) for HDFS access<b=
r>


+ exec /usr/lib/jvm/java-6-sun-1.6.0.26/jre/bin/java -Xms100m -Xmx200m -cp =
&#39;/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/conf:/usr/l=
ocal/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/lib/*:/usr/local/flume=
_dir/flume/flume-1.2.0-incubating-SNAPSHOT/conf&#39; -Djava.library.path=3D=
:/usr/local/hadoop/bin/../lib/native/Linux-i386-32 org.apache.flume.node.Ap=
plication -n agent1 -f conf/agent1.conf</div>


</blockquote></div><div><br>This is really strange. Your java.library.path =
is set to /usr/local/hadoop/lib/native/Linux-i386-32 but for some reason th=
e output of &quot;hadoop classpath&quot; has not made it into your classpat=
h. I&#39;ve never seen that combination before - usually both are there or =
both are missing. That&#39;s because the same hadoop binary is used for bot=
h cases. Are you on a 32-bit OS? I don&#39;t know if anyone has ever tested=
 Flume on a 32-bit OS.<br>


<br>If you can post the output of the following 6 commands, it might give u=
s more to go on:<br><br>which hadoop<br>echo $HADOOP_HOME<br>hadoop classpa=
th<br>which java<br>echo $JAVA_HOME<br>java -version<br><br>If you are flue=
nt in shell scripting, you can also trace the bin/flume-ng script and see w=
here it&#39;s going wrong. Or just invoke it as:<br>


<br>=A0 bash -x bin/flume-ng agent -n agent1 -c conf -f conf/agent1.conf<br=
><br>And post the output of that as well (it will be quite long).<br><br>Re=
gards,<br>Mike<br><br></div></div>
</blockquote></div><br></div>

--20cf3071c874de86cf04c3f08a75--