flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vijay k <k.vija...@gmail.com>
Subject Re: Flume agent failure
Date Wed, 04 Jul 2012 13:51:10 GMT
I have already downloaded the hadoop-0.20.204.0.tar.gz,

shall i go ahead  with hadoop 0.20.204 ver installation. please confirm it
is compatible with flume 1.2.0 version?

Thanks,
Vijay

On Wed, Jul 4, 2012 at 7:03 PM, alo alt <wget.null@gmail.com> wrote:

> 1. Flume uses the libs from the classpath
> 2. remove the installed hadoop version (apt-get remove hadoop*)
> 3. http://hadoop.apache.org/common/docs/   => click at the version you
> want to install and follow the steps described there
>
> - Alex
>
> On Jul 4, 2012, at 2:36 PM, vijay k wrote:
>
> > Hi Alex,
> >
> > I have installed hadoop via tar xzf hadoop-0.20.2.zip in Ubuntu, but i
> > could not able to find the *hadoop-install* directory.
>  > Please let me know the following query's
> >
> > 1. which latest HADOOP version is compatible with FLUME 1.2.0 .
> > 2. if need to remove my hadoop 0.20.0 version, how to remove the older
> > version.
> > 3. and provide the hadoop latest version installation steps.
> >
> > Thanks a lot for your comments.
> >
> >
> >
> > On Wed, Jul 4, 2012 at 5:28 PM, alo alt <wget.null@gmail.com> wrote:
> >
> >> U're on Ubuntu / Debian?
> >>
> >> If yes, remove the hadoop installation via apt, you have an really old
> one
> >> installed. Take a look into the /usr/local/hadoop/lib directory (as you
> >> posted before):
> >>
> >> -rw-r--r-- 1 hduser hadoop   15010 2010-02-19 13:25 xmlenc-0.52.jar
> >> -rw-r--r-- 1 hduser hadoop    8601 2010-02-19 13:25
> slf4j-log4j12-1.4.3.jar
> >>
> >> and so on. From 2010 - pretty old.
> >>
> >> How do you installed hadoop? I think you've done already from the
> tarball
> >> into /hadoop-install/hadoop - there should be a ../lib dir too. Export
> >> these and try again.
> >>
> >> - Alex
> >>
> >>
> >> On Jul 4, 2012, at 1:50 PM, vijay k wrote:
> >>
> >>> Hi Alex,
> >>>
> >>> I have set the HADOOP_CLASSPATH=/usr/local/hadoop/lib only, but still
> am
> >>> unable to proceed further.
> >>> Please find the attached flume-ng script. Please guide me if i did
> >> anything
> >>> wrong in the script
> >>>
> >>> Thanks a lot for your helping to proceed further.
> >>>
> >>>
> >>> On Wed, Jul 4, 2012 at 5:08 PM, alo alt <wget.null@gmail.com> wrote:
> >>>
> >>>> Hi Vijay,
> >>>>
> >>>> but you've set the path to:
> >>>>> hadoop classpath        -- /usr/local/hadoop/bin/hadoop
> >>>>
> >>>> should be: /usr/local/hadoop/lib
> >>>>
> >>>> Flume reads out the variable and look into that path for all needed
> >>>> classes / jars. But in /usr/local/hadoop/bin/hadoop flume found
> nothing.
> >>>>
> >>>> - Alex
> >>>>
> >>>>
> >>>> On Jul 4, 2012, at 1:33 PM, vijay k wrote:
> >>>>
> >>>>> Hi Alex,
> >>>>>
> >>>>> Hadoop lib are installed following path
> >>>>>
> >>>>> root@md-trngpoc1
> >>>> :/usr/local/flume_dir/flume/flume-1.2.0-incubating-SNAPSHOT/bin#
> >>>>> cd /usr/local/hadoop/lib
> >>>>> root@md-trngpoc1:/usr/local/hadoop/lib# ls -lrt
> >>>>> total 8428
> >>>>
> >>>>
> >>>> --
> >>>> Alexander Alten-Lorenz
> >>>> http://mapredit.blogspot.com
> >>>> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
> >>>>
> >>>>
> >>> <flume-ng script.txt>
> >>
> >>
> >> --
> >> Alexander Alten-Lorenz
> >> http://mapredit.blogspot.com
> >> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
> >>
> >>
>
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>

Mime
View raw message