flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From alo alt <wget.n...@gmail.com>
Subject Re: Flume agent failure
Date Wed, 04 Jul 2012 13:33:58 GMT
1. Flume uses the libs from the classpath
2. remove the installed hadoop version (apt-get remove hadoop*)
3. http://hadoop.apache.org/common/docs/   => click at the version you want to install
and follow the steps described there

- Alex

On Jul 4, 2012, at 2:36 PM, vijay k wrote:

> Hi Alex,
> 
> I have installed hadoop via tar xzf hadoop-0.20.2.zip in Ubuntu, but i
> could not able to find the *hadoop-install* directory.
> Please let me know the following query's
> 
> 1. which latest HADOOP version is compatible with FLUME 1.2.0 .
> 2. if need to remove my hadoop 0.20.0 version, how to remove the older
> version.
> 3. and provide the hadoop latest version installation steps.
> 
> Thanks a lot for your comments.
> 
> 
> 
> On Wed, Jul 4, 2012 at 5:28 PM, alo alt <wget.null@gmail.com> wrote:
> 
>> U're on Ubuntu / Debian?
>> 
>> If yes, remove the hadoop installation via apt, you have an really old one
>> installed. Take a look into the /usr/local/hadoop/lib directory (as you
>> posted before):
>> 
>> -rw-r--r-- 1 hduser hadoop   15010 2010-02-19 13:25 xmlenc-0.52.jar
>> -rw-r--r-- 1 hduser hadoop    8601 2010-02-19 13:25 slf4j-log4j12-1.4.3.jar
>> 
>> and so on. From 2010 - pretty old.
>> 
>> How do you installed hadoop? I think you've done already from the tarball
>> into /hadoop-install/hadoop - there should be a ../lib dir too. Export
>> these and try again.
>> 
>> - Alex
>> 
>> 
>> On Jul 4, 2012, at 1:50 PM, vijay k wrote:
>> 
>>> Hi Alex,
>>> 
>>> I have set the HADOOP_CLASSPATH=/usr/local/hadoop/lib only, but still am
>>> unable to proceed further.
>>> Please find the attached flume-ng script. Please guide me if i did
>> anything
>>> wrong in the script
>>> 
>>> Thanks a lot for your helping to proceed further.
>>> 
>>> 
>>> On Wed, Jul 4, 2012 at 5:08 PM, alo alt <wget.null@gmail.com> wrote:
>>> 
>>>> Hi Vijay,
>>>> 
>>>> but you've set the path to:
>>>>> hadoop classpath        -- /usr/local/hadoop/bin/hadoop
>>>> 
>>>> should be: /usr/local/hadoop/lib
>>>> 
>>>> Flume reads out the variable and look into that path for all needed
>>>> classes / jars. But in /usr/local/hadoop/bin/hadoop flume found nothing.
>>>> 
>>>> - Alex
>>>> 
>>>> 
>>>> On Jul 4, 2012, at 1:33 PM, vijay k wrote:
>>>> 
>>>>> Hi Alex,
>>>>> 
>>>>> Hadoop lib are installed following path
>>>>> 
>>>>> root@md-trngpoc1
>>>> :/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/bin#
>>>>> cd /usr/local/hadoop/lib
>>>>> root@md-trngpoc1:/usr/local/hadoop/lib# ls -lrt
>>>>> total 8428
>>>> 
>>>> 
>>>> --
>>>> Alexander Alten-Lorenz
>>>> http://mapredit.blogspot.com
>>>> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>>>> 
>>>> 
>>> <flume-ng script.txt>
>> 
>> 
>> --
>> Alexander Alten-Lorenz
>> http://mapredit.blogspot.com
>> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>> 
>> 


--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF


Mime
View raw message