hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ahmed Eldawy <aseld...@gmail.com>
Subject Re: Hadoop running the incorrect class
Date Fri, 17 May 2013 00:08:49 GMT
Thanks Harsh. JarFinder helped me locating the guilty jar file. It was in
the hadoop class path indeed but I didn't think it has a copy of the main
class.
Thanks for your help.

Ahmed

Best regards,
Ahmed Eldawy


On Thu, May 16, 2013 at 5:56 PM, Harsh J <harsh@cloudera.com> wrote:

> Check your "hadoop classpath" output - check on the output if your jar
> was placed on it directly.
>
> Alternatively, use a tool such as
> https://github.com/mreid-moz/JarFinder, etc. to help you locate the
> offending jar or class bits.
>
> On Fri, May 17, 2013 at 2:29 AM, Ahmed Eldawy <aseldawy@gmail.com> wrote:
> > Hi all,
> >   I'm having a very silly problem that is making me pull the hair out of
> my
> > head. I created a program and generated a jar out of it. The program was
> > running fine for a long time (months) and I was updating it regularly and
> > everything was going fine. Just yesterday, I started to have a very weird
> > case. I update my program, create the jar file, but when running the new
> jar
> > file, the old class is the one that is actually running. I'm sure the jar
> > file was created correctly because when I run the jar file directly using
> > "java -jar", it runs the correct updated class. This problem only happens
> > when using hadoop. I think it caches the old class somewhere. I tried to
> > restart my machine to make sure all tmp files are cleared but still the
> same
> > problem. I even went further by opening the jar file and deleting the
> main
> > class. Even after deleting the class, hadoop still runs the old class. I
> > removed all classes from the jar file and left only the META-INF files
> and
> > it still executes the old class.
> >
> > I must have did something wrong in the last few days that caused this
> > problem to happen but I really can't figure out what the problem is. The
> > only thing I remember is that I created another hadoop installation that
> > runs in different ports to try different things in both clusters.
> However, I
> > removed all traces of the other binary distribution and I'm currently
> > running the jar file without any hadoop processes running. So, there is
> no
> > actual cluster running here.
> >
> > Please help me.
> >
> > Thanks
> > Ahmed
> >
> > Best regards,
> > Ahmed Eldawy
>
>
>
> --
> Harsh J
>

Mime
View raw message