Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E71FB407A for ; Wed, 11 May 2011 18:29:29 +0000 (UTC) Received: (qmail 6845 invoked by uid 500); 11 May 2011 18:29:29 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 6804 invoked by uid 500); 11 May 2011 18:29:29 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 6796 invoked by uid 99); 11 May 2011 18:29:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 May 2011 18:29:29 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 May 2011 18:29:28 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id E981445E71 for ; Wed, 11 May 2011 18:28:49 +0000 (UTC) Date: Wed, 11 May 2011 18:28:49 +0000 (UTC) From: "Tsz Wo (Nicholas), SZE (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <1942152866.4110.1305138529952.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <2108193596.3999.1305137747997.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (MAPREDUCE-2483) Clean up duplication of dependent jar files MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAPREDUCE-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13031926#comment-13031926 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-2483: --------------------------------------------------- There are also duplicated dependent jars from codes and tests (e.g the same jar will appear in both {{build/ivy/lib/hadoop-hdfs/common/}} and {{build/ivy/lib/hadoop-hdfs/test/}}). See if you want to fix it here. > Clean up duplication of dependent jar files > ------------------------------------------- > > Key: MAPREDUCE-2483 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2483 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build > Affects Versions: 0.23.0 > Reporter: Eric Yang > > For trunk, the build and deployment tree look like this: > hadoop-common-0.2x.y > hadoop-hdfs-0.2x.y > hadoop-mapred-0.2x.y > Technically, mapred's the third party dependent jar files should be fetch from hadoop-common and hadoop-hdfs. However, it is currently fetching from hadoop-mapred/lib only. It would be nice to eliminate the need to repeat duplicated jar files at build time. > There are two options to manage this dependency list, continue to enhance ant build structure to fetch and filter jar file dependencies using ivy. On the other hand, it would be a good opportunity to convert the build structure to maven, and use maven to manage the provided jar files. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira