hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matthias Friedrich <m...@mafr.de>
Subject Maven dependencies for LocalJobRunner?
Date Sun, 07 Oct 2012 07:38:07 GMT

when running a simple word count example with Hadoop 1.0.3 and
2.0.1-alpha from the IDE (that is, without "hadoop jar"), I get
ClassNotFoundExceptions because LocalJobRunner needs dependencies
that are not referenced from hadoop-client's POM. For 1.0.3 it's
commons-cli and commons-httpclient, and for 2.0.1-alpha it's
commons-cli, commons-httpclient, and avro.

Things work fine when I add them, but I think since these libraries
are part of Hadoop's runtime classpath they should also be referenced
from the POM. Otherwise users might add them in different versions to
their classpath, which may lead to code breaking on the cluster that
worked fine locally.

So, question is: Is this a bug in Hadoop's POMs or is there something
I'm overlooking?


View raw message