Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 99668 invoked from network); 13 Mar 2010 03:05:10 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 13 Mar 2010 03:05:10 -0000 Received: (qmail 62356 invoked by uid 500); 13 Mar 2010 03:04:31 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 62147 invoked by uid 500); 13 Mar 2010 03:04:31 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 62139 invoked by uid 99); 13 Mar 2010 03:04:30 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Mar 2010 03:04:30 +0000 X-ASF-Spam-Status: No, hits=0.3 required=10.0 tests=DC_IMAGE_SPAM_HTML,DC_IMAGE_SPAM_TEXT,DC_PNG_UNO_LARGO,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [203.89.202.182] (HELO postoffice2.aconex.com) (203.89.202.182) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 13 Mar 2010 03:04:29 +0000 X-ASG-Debug-ID: 1268449441-4a6300250000-qbaNgu X-Barracuda-URL: http://postoffice2.aconex.com:8000/cgi-bin/mark.cgi Received: from postoffice.aconex.com (localhost [127.0.0.1]) by postoffice2.aconex.com (Spam & Virus Firewall) with ESMTP id EC18E815512 for ; Sat, 13 Mar 2010 14:04:01 +1100 (EST) Received: from postoffice.aconex.com (postoffice.yarra.acx [192.168.102.1]) by postoffice2.aconex.com with ESMTP id r0MRz99DvVbqp3EY for ; Sat, 13 Mar 2010 14:04:01 +1100 (EST) X-Barracuda-Envelope-From: psmith@aconex.com Received: from gatekeeper.aconex.com (gatekeeper.yarra.acx [192.168.102.10]) by postoffice.aconex.com (Postfix) with ESMTP id 28E29A50280 for ; Sat, 13 Mar 2010 14:01:18 +1100 (EST) Received: from localhost (localhost.localdomain [127.0.0.1]) by gatekeeper.aconex.com (Postfix) with ESMTP id D7A0A488488 for ; Sat, 13 Mar 2010 14:04:01 +1100 (EST) X-Virus-Scanned: amavisd-new at aconex.com Received: from gatekeeper.aconex.com ([127.0.0.1]) by localhost (gatekeeper.aconex.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3OrKj6SKRrOv for ; Sat, 13 Mar 2010 14:03:57 +1100 (EST) Received: from [192.168.0.10] (unknown [120.147.12.19]) by gatekeeper.aconex.com (Postfix) with ESMTP id 2FF9C488484 for ; Sat, 13 Mar 2010 14:03:57 +1100 (EST) From: Paul Smith Content-Type: multipart/mixed; boundary=Apple-Mail-82-231941655 X-ASG-Orig-Subj: Maven assembly speed issue (from discussion with jdcryans on IRC) Subject: Maven assembly speed issue (from discussion with jdcryans on IRC) Date: Sat, 13 Mar 2010 14:03:53 +1100 Message-Id: <79B274BD-CB9A-4B81-B224-C0A7F85864EF@aconex.com> To: hbase-dev@hadoop.apache.org Mime-Version: 1.0 (Apple Message framework v1077) X-Mailer: Apple Mail (2.1077) X-Barracuda-Connect: postoffice.yarra.acx[192.168.102.1] X-Barracuda-Start-Time: 1268449441 X-Barracuda-Virus-Scanned: by Aconex Staff Email Spam Firewall at aconex.com --Apple-Mail-82-231941655 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii chatting with jdcryans on IRC, it appears 'mvn ... assembly:directory' = is SLOOOW. and sure it enough, it's running like molasses. A couple of observations including some random thread-dumping , looks = like Maven does a fair number of process forks to get file attributes, = you can see the hideousness here: --Apple-Mail-82-231941655 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii A bit of research I came across this issue with the Maven Assembly = plugin. http://jira.codehaus.org/browse/MASSEMBLY-424 Because the current pom doesn't specify a plugin version, it's using the = latest version. By configuring the plugin version to be = 2.2-beta-1 =20 we get much faster builds, at the slight expense of now having the = directory ending in '.dir'. Supposedly this is a subtle change in the = beta plugins, see the definition of a attribute = 'ignoreDirFormatExtensions' here: = http://maven.apache.org/plugins/maven-assembly-plugin/directory-mojo.html I would also recommend stripping out the 2 in the = assembly plugin definition (for 'project' and 'src'); they're not needed = now, and were put therefor discussion more than anything else, I think = they're just getting in the way at the moment. so, in short, I propose this diff to keep us going forward: diff --git a/pom.xml b/pom.xml index d70dd70..026431c 100644 --- a/pom.xml +++ b/pom.xml @@ -293,6 +293,7 @@ maven-assembly-plugin + 2.2-beta-1