hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pantazis Deligiannis <akis1...@gmail.com>
Subject Compiling a mapreduce job under the new Apache Hadoop YARN
Date Sat, 11 Aug 2012 01:55:30 GMT
In the old Hadoop mapreduce v1 framework (e.g. 1.0.3) the way to compile a job was using the
already provided "hadoop-core-HADOOP_VERSION.jar" through the following command:

    javac -cp ".../hadoop-core-HADOOP_VERSION.jar" -d class_dir Example.java

In the newest releases for Hadoop mapreduce v2 YARN (e.g. 2.0.1-alpha or the cloudera 4.0)
a similar core.jar is not provided, though, to be used during compilation. The closest i have
managed to get is by using the "hadoop-common-2.0.1-alpha.jar" in the /share/hadoop/common
dir but this still leaves a lot of compilation errors.

Is there some other specific way or using different jars for compiling a YARN job? Or maybe
for some reason you need to build the source yourself in the new releases to get the core.jar?
I have searched quite a lot but can't find a relevant answer.

Thank you very much!
View raw message