Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 47FF5D27B for ; Sun, 7 Oct 2012 07:38:54 +0000 (UTC) Received: (qmail 60034 invoked by uid 500); 7 Oct 2012 07:38:49 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 59516 invoked by uid 500); 7 Oct 2012 07:38:42 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 59445 invoked by uid 99); 7 Oct 2012 07:38:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 07 Oct 2012 07:38:40 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_HELO_PASS,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [212.227.126.171] (HELO moutng.kundenserver.de) (212.227.126.171) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 07 Oct 2012 07:38:30 +0000 Received: from mafr.de (krlh-4d036637.pool.mediaWays.net [77.3.102.55]) by mrelayeu.kundenserver.de (node=mrbap0) with ESMTP (Nemesis) id 0M835V-1TXsPb0Itt-00vHqi; Sun, 07 Oct 2012 09:38:10 +0200 Date: Sun, 7 Oct 2012 09:38:07 +0200 From: Matthias Friedrich To: user@hadoop.apache.org Subject: Maven dependencies for LocalJobRunner? Message-ID: <20121007073807.GA18989@mafr.de> Mail-Followup-To: user@hadoop.apache.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) X-Provags-ID: V02:K0:GNtg8o7UIJCNy/FMzLzCj3M9XcxInGzrAb9OfGVr6fj G2dPzU8QLmZyxOrMuYdZUBWqrDzyabyMBYPzN4jM9Gc8odfXah nevveGFoUZXP3Zrm6IYWTwejkzyti7WqrNUL+BVeCkSZEQkJAV LJ5ff/C2ZpNNExX2lvg4oUdWWKf4AWQ+/Vs2iSldhJ2R93tD69 x0igykERSHthCSfV5U+jBEpOlyVdrho4JysCQAoY7dsl2r3LSI v9qTwen9SRBvBdQGDdYHdhRi5emQWrLwFiFN1XpK9tGhG7A3DQ GbaJ3R1DsJ0YLKxVNK50ofiNFztZpuZSqMrhbIK+p8WINMcWA= = Hi, when running a simple word count example with Hadoop 1.0.3 and 2.0.1-alpha from the IDE (that is, without "hadoop jar"), I get ClassNotFoundExceptions because LocalJobRunner needs dependencies that are not referenced from hadoop-client's POM. For 1.0.3 it's commons-cli and commons-httpclient, and for 2.0.1-alpha it's commons-cli, commons-httpclient, and avro. Things work fine when I add them, but I think since these libraries are part of Hadoop's runtime classpath they should also be referenced from the POM. Otherwise users might add them in different versions to their classpath, which may lead to code breaking on the cluster that worked fine locally. So, question is: Is this a bug in Hadoop's POMs or is there something I'm overlooking? Thanks, Matthias