Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 64DDD9CD3 for ; Sat, 11 Aug 2012 01:56:06 +0000 (UTC) Received: (qmail 79368 invoked by uid 500); 11 Aug 2012 01:56:01 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 79225 invoked by uid 500); 11 Aug 2012 01:56:01 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 79217 invoked by uid 99); 11 Aug 2012 01:56:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Aug 2012 01:56:01 +0000 X-ASF-Spam-Status: No, hits=-0.5 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of akis1986@gmail.com designates 74.125.82.176 as permitted sender) Received: from [74.125.82.176] (HELO mail-we0-f176.google.com) (74.125.82.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Aug 2012 01:55:53 +0000 Received: by weyu3 with SMTP id u3so1603102wey.35 for ; Fri, 10 Aug 2012 18:55:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version:x-mailer; bh=9gFDJ8/ou5jWKU0U40WVJVXJwElYLoUUSQ5RQwgX80w=; b=GOT2Wwp/LLepwlEbm5CYrNhj6llD4MR8IXFpkVUz1/Cbo4ui+DyIq70QjTcjaVGjoh ZzpDo9ykme+e874nc4yh7I+myFwCTMkzNVikfmPN1IB4BI1yzyYWfYsgmtWdsca9dm0o Tq5zRvsBr/GE5FQStMq2sO3I8Hsg7SNgB5TzSzqe6xZabTvUPk7bwiJn0EUx5Jn5oGdg EohOWXWK1IfXR21mDvNugu1vtr6m11431Yrrgp6YSdo9HnNfugZguGnp3sHwC1tk7Rvx dURuVU0YOLGQOZg41sScWSvI6UfP1LPF2Hixx61d/2firgUWbvTWqPEWOUFMoS/Vchja /fQg== Received: by 10.180.86.106 with SMTP id o10mr548776wiz.22.1344650132274; Fri, 10 Aug 2012 18:55:32 -0700 (PDT) Received: from [192.168.1.64] (188-221-64-62.zone12.bethere.co.uk. [188.221.64.62]) by mx.google.com with ESMTPS id fr4sm1556474wib.8.2012.08.10.18.55.31 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 10 Aug 2012 18:55:31 -0700 (PDT) From: Pantazis Deligiannis Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Compiling a mapreduce job under the new Apache Hadoop YARN Message-Id: <5F42B825-A4E0-436D-9368-EDA05BDC5C76@gmail.com> Date: Sat, 11 Aug 2012 02:55:30 +0100 To: user@hadoop.apache.org Mime-Version: 1.0 (Mac OS X Mail 6.0 \(1485\)) X-Mailer: Apple Mail (2.1485) X-Virus-Checked: Checked by ClamAV on apache.org In the old Hadoop mapreduce v1 framework (e.g. 1.0.3) the way to compile = a job was using the already provided "hadoop-core-HADOOP_VERSION.jar" = through the following command: javac -cp ".../hadoop-core-HADOOP_VERSION.jar" -d class_dir = Example.java In the newest releases for Hadoop mapreduce v2 YARN (e.g. 2.0.1-alpha or = the cloudera 4.0) a similar core.jar is not provided, though, to be used = during compilation. The closest i have managed to get is by using the = "hadoop-common-2.0.1-alpha.jar" in the /share/hadoop/common dir but this = still leaves a lot of compilation errors. Is there some other specific way or using different jars for compiling a = YARN job? Or maybe for some reason you need to build the source yourself = in the new releases to get the core.jar? I have searched quite a lot but = can't find a relevant answer. Thank you very much!=