ant-ivy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sebastian Gozin <sebastian.go...@newtec.eu>
Subject very slow dependency resolution when running ivy from gant
Date Wed, 09 Jun 2010 13:27:52 GMT
I have a gant script which resolves an ivy.xml file with just 2 dependencies defined but a
fair amount of transitive dependencies.
These dependencies are then copied to a local folder. I did some debugging and noticed that
the actual downloading takes almost no time at all but still there is a lot of delay between
downloading of individual dependencies. Almost like parsing the Maven pom files is very slow
(speculation).

To give an indication of how bad it is if I delete the .ivy2/cache folder and run the task
again it takes around 15 minutes just to get to the point where ivy actually downloads the
dependencies.

Has anyone observed this problem before? Any ideas?
I can reproduce this on pretty much any system going from ubuntu, fedora, centos, osx. Only
thing I didn't try was windows.

gant task definition:
target('get-dependencies':'Install dependencies') {
        def lib = new File("lib")
        lib.mkdirs()

        ivy.settings(file:"${System.getProperty('user.home')}/.ivy2/ivysettings-newtec.xml")
        ivy.resolve(file:'ivy.xml')
        ivy.retrieve(pattern:"$lib.absolutePath/[artifact].[ext]")
}

stdout log:
03-May-2010 08:44:26  	get-dependencies:
03-May-2010 08:44:26 	Clearing old library folder /home/bob/bamboo-agent-home/xml-data/build-dir/S3PVAL-S3PVT/lib...
done!
03-May-2010 08:44:27 	Copying libraries to /home/bob/bamboo-agent-home/xml-data/build-dir/S3PVAL-S3PVT/lib...::
Ivy 2.1.0 - 20090925235825 :: http://ant.apache.org/ivy/ ::
03-May-2010 08:44:27 	[antlib:org.apache.ivy.ant:resolve] :: loading settings :: file = /home/bob/.ivy2/ivysettings-newtec.xml
03-May-2010 08:44:27 	[antlib:org.apache.ivy.ant:resolve] :: resolving dependencies :: ntc.val.sat3play-tests#sat3play-tests;working@valautm.build.eng-it.newtec.be
03-May-2010 08:44:27 	[antlib:org.apache.ivy.ant:resolve]         confs: [build, compile,
test, runtime]
03-May-2010 08:45:06 	[antlib:org.apache.ivy.ant:resolve]         found commons-lang#commons-lang;2.4
in maven-newtec
03-May-2010 08:45:52 	[antlib:org.apache.ivy.ant:resolve]         found ntc.val.sat3play-tests#sat3play-tests-jar;1.2.2-RC3
in maven-newtec
03-May-2010 08:46:32 	[antlib:org.apache.ivy.ant:resolve]         found ntc.nms.sat3play#cli-resource-scripts-jar;2.0.11
in maven-newtec
03-May-2010 08:46:33 	[antlib:org.apache.ivy.ant:resolve]         found org.easyb#easyb;0.9.6
in maven-newtec
03-May-2010 08:46:33 	[antlib:org.apache.ivy.ant:resolve]         found commons-cli#commons-cli;1.1
in maven-newtec
03-May-2010 08:46:33 	[antlib:org.apache.ivy.ant:resolve]         found ntc.nms.sat3play.cmt#co-cmt-interface;2.0.10
in maven-newtec
03-May-2010 08:46:33 	[antlib:org.apache.ivy.ant:resolve]         found ntc.nms.datatypes#datatypes;1.0.8
in maven-newtec
03-May-2010 08:46:45 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring;2.5.5
in maven-newtec
03-May-2010 08:46:46 	[antlib:org.apache.ivy.ant:resolve]         found ntc.val#cpe-portal-interface;1.0.5
in maven-newtec
03-May-2010 08:47:23 	[antlib:org.apache.ivy.ant:resolve]         found org.grails#grails-spring;1.2.0
in maven-newtec
03-May-2010 08:47:50 	[antlib:org.apache.ivy.ant:resolve]         found org.slf4j#jcl-over-slf4j;1.5.8
in maven-newtec
03-May-2010 08:48:02 	[antlib:org.apache.ivy.ant:resolve]         found org.slf4j#slf4j-api;1.5.8
in maven-newtec
03-May-2010 08:48:14 	[antlib:org.apache.ivy.ant:resolve]         found org.slf4j#jul-to-slf4j;1.5.8
in maven-newtec
03-May-2010 08:48:46 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-core;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:48:57 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-asm;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:49:10 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-beans;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:49:22 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-context;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:49:35 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-expression;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:49:47 	[antlib:org.apache.ivy.ant:resolve]         found org.slf4j#slf4j-log4j12;1.5.8
in maven-newtec
03-May-2010 08:49:57 	[antlib:org.apache.ivy.ant:resolve]         found log4j#log4j;1.2.14
in maven-newtec
03-May-2010 08:49:58 	[antlib:org.apache.ivy.ant:resolve]         found org.codehaus.groovy#groovy-all;1.7.1
in maven-newtec
03-May-2010 08:50:09 	[antlib:org.apache.ivy.ant:resolve]         found jline#jline;0.9.94
in maven-newtec
03-May-2010 08:50:41 	[antlib:org.apache.ivy.ant:resolve]         found org.codehaus.gant#gant_groovy1.6;1.7.0
in maven-newtec
03-May-2010 08:50:54 	[antlib:org.apache.ivy.ant:resolve]         found commons-cli#commons-cli;1.2
in maven-newtec
03-May-2010 08:51:17 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.ant#ant;1.7.1
in maven-newtec
03-May-2010 08:51:45 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.ant#ant-launcher;1.7.1
in maven-newtec
03-May-2010 08:52:10 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-ant-tasks;2.0.10
in maven-newtec
03-May-2010 08:52:34 	[antlib:org.apache.ivy.ant:resolve]         found classworlds#classworlds;1.1-alpha-2
in maven-newtec
03-May-2010 08:52:58 	[antlib:org.apache.ivy.ant:resolve]         found org.codehaus.plexus#plexus-container-default;1.0-alpha-9-stable-1
in maven-newtec
03-May-2010 08:53:10 	[antlib:org.apache.ivy.ant:resolve]         found org.codehaus.plexus#plexus-utils;1.5.5
in maven-newtec
03-May-2010 08:53:35 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-artifact;2.0.10
in maven-newtec
03-May-2010 08:53:35 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-artifact-manager;2.0.10
in maven-newtec
03-May-2010 08:53:35 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-repository-metadata;2.0.10
in maven-newtec
03-May-2010 08:54:20 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven.wagon#wagon-provider-api;1.0-beta-2
in maven-newtec
03-May-2010 08:54:20 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-model;2.0.10
in maven-newtec
03-May-2010 08:54:20 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-project;2.0.10
in maven-newtec
03-May-2010 08:54:20 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-settings;2.0.10
in maven-newtec
03-May-2010 08:54:20 	[antlib:org.apache.ivy.ant:resolve]         found org.codehaus.plexus#plexus-interpolation;1.1
in maven-newtec
03-May-2010 08:54:20 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-profile;2.0.10
in maven-newtec
03-May-2010 08:54:21 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-plugin-registry;2.0.10
in maven-newtec
03-May-2010 08:54:21 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-error-diagnostics;2.0.10
in maven-newtec
03-May-2010 08:54:36 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven.wagon#wagon-file;1.0-beta-2
in maven-newtec
03-May-2010 08:54:36 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven.wagon#wagon-http-lightweight;1.0-beta-2
in maven-newtec
03-May-2010 08:54:36 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.maven.wagon#wagon-http-shared;1.0-beta-2
in maven-newtec
03-May-2010 08:54:36 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.ivy#ivy;2.1.0-rc2
in maven-newtec
03-May-2010 08:55:01 	[antlib:org.apache.ivy.ant:resolve]         found org.apache.ant#ant-jsch;1.7.1
in maven-newtec
03-May-2010 08:55:13 	[antlib:org.apache.ivy.ant:resolve]         found com.jcraft#jsch;0.1.29
in maven-newtec
03-May-2010 08:55:13 	[antlib:org.apache.ivy.ant:resolve] jsch#jsch;0.1.29 is relocated to
com.jcraft#jsch;0.1.29. Please update your dependencies.
03-May-2010 08:55:13 	[antlib:org.apache.ivy.ant:resolve]         found jsch#jsch;0.1.29 in
maven-newtec
03-May-2010 08:55:25 	[antlib:org.apache.ivy.ant:resolve]         found joda-time#joda-time;1.4
in maven-newtec
03-May-2010 08:55:41 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework.ws#spring-ws-core;1.5.8
in maven-newtec
03-May-2010 08:55:41 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework.ws#spring-xml;1.5.8
in maven-newtec
03-May-2010 08:55:41 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework.ws#spring-oxm;1.5.8
in maven-newtec
03-May-2010 08:55:54 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-aop;2.5.6
in maven-newtec
03-May-2010 08:56:07 	[antlib:org.apache.ivy.ant:resolve]         found aopalliance#aopalliance;1.0
in maven-newtec
03-May-2010 08:56:18 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-web;2.5.6
in maven-newtec
03-May-2010 08:56:30 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-webmvc;2.5.6
in maven-newtec
03-May-2010 08:56:45 	[antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-context-support;2.5.6
in maven-newtec
03-May-2010 08:56:45 	[antlib:org.apache.ivy.ant:resolve]         found wsdl4j#wsdl4j;1.6.1
in maven-newtec
03-May-2010 08:57:14 	[antlib:org.apache.ivy.ant:resolve]         found org.codehaus.gpars#gpars;0.9
in maven-newtec
03-May-2010 08:58:06 	[antlib:org.apache.ivy.ant:resolve]         found org.coconut.forkjoin#jsr166y;070108
in maven-newtec
03-May-2010 08:58:18 	[antlib:org.apache.ivy.ant:resolve]         found org.jboss.netty#netty;3.1.5.GA
in maven-newtec
03-May-2010 08:58:29 	[antlib:org.apache.ivy.ant:resolve]         found net.sourceforge.htmlunit#htmlunit;2.7
in maven-newtec
03-May-2010 08:58:41 	[antlib:org.apache.ivy.ant:resolve]         found xalan#xalan;2.7.1
in maven-newtec
03-May-2010 08:59:06 	[antlib:org.apache.ivy.ant:resolve]         found xalan#serializer;2.7.1
in maven-newtec
03-May-2010 08:59:07 	[antlib:org.apache.ivy.ant:resolve]         found commons-collections#commons-collections;3.2.1
in maven-newtec
03-May-2010 08:59:20 	[antlib:org.apache.ivy.ant:resolve]         found commons-httpclient#commons-httpclient;3.1
in maven-newtec
03-May-2010 08:59:21 	[antlib:org.apache.ivy.ant:resolve]         found commons-codec#commons-codec;1.4
in maven-newtec
03-May-2010 08:59:32 	[antlib:org.apache.ivy.ant:resolve]         found net.sourceforge.htmlunit#htmlunit-core-js;2.7
in maven-newtec
03-May-2010 08:59:58 	[antlib:org.apache.ivy.ant:resolve]         found xerces#xercesImpl;2.9.1
in maven-newtec
03-May-2010 08:59:58 	[antlib:org.apache.ivy.ant:resolve]         found net.sourceforge.nekohtml#nekohtml;1.9.14
in maven-newtec
03-May-2010 09:00:17 	[antlib:org.apache.ivy.ant:resolve]         found net.sourceforge.cssparser#cssparser;0.9.5
in maven-newtec
03-May-2010 09:00:30 	[antlib:org.apache.ivy.ant:resolve]         found org.w3c.css#sac;1.3
in maven-newtec
03-May-2010 09:00:42 	[antlib:org.apache.ivy.ant:resolve]         found commons-io#commons-io;1.4
in maven-newtec
03-May-2010 09:00:42 	[antlib:org.apache.ivy.ant:resolve] downloading http://archiva.eng-it.newtec.be/repository/ntc-repo/commons-lang/commons-lang/2.4/commons-lang-2.4.jar
...
03-May-2010 09:00:42 	[antlib:org.apache.ivy.ant:resolve] ....................................................................................................
(255kB)


Newtec’s MENOS system awarded IBC Innovation Award for Content Delivery & the IBC Judges’
Award  Newtec’s FlexACM awarded 2009 Teleport Technology of the Year by WTA  *** e-mail
confidentiality footer *** This message and any attachments thereto are confidential. They
may also be privileged or otherwise protected by work product immunity or other legal rules.
If you have received it by mistake, please let us know by e-mail reply and delete it from
your system; you may not copy this message or disclose its contents to anyone. E-mail transmission
cannot be guaranteed to be secure or error free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore is in
no way liable for any errors or omissions in the content of this message, which may arise
as a result of e-mail transmission. If verification is required, please request a hard copy.

Mime
View raw message