ant-ivy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sebastian Gozin <sebastian.go...@newtec.eu>
Subject Re: very slow dependency resolution when running ivy from gant
Date Fri, 11 Jun 2010 05:39:00 GMT
I'm not exactly sure how to set the log level when running ivy from ant. Couldn't find much
in the overview of ant targets on the apache website.
I figured out how to do it when running ivy standalone but then I lose the timestamp logs
and I figure we want to see those.

Running it without the timestamps though I did notice a lot of failures for javadoc and sources
on libraries which do not have any (might be partly related to archiva not serving them).
I tried to figure out how to disable resolution of these secondary artifacts but so far have
been unsuccesful. Seems like I need to do something with !javadoc and !source in the dependency
conf but just what is not clear to me.

Sebastian


----- Original Message -----
From: "Maarten Coene" <maarten_coene@yahoo.com>
To: ivy-user@ant.apache.org
Sent: Wednesday, June 9, 2010 10:26:01 PM GMT +01:00 Amsterdam / Berlin / Bern / Rome / Stockholm
/ Vienna
Subject: Re: very slow dependency resolution when running ivy from gant

Oh yes, please do this with a recent Ivy snapshot.
You can download one here: http://hudson.zones.apache.org/hudson/view/Ant/job/Ivy/

Maarten




----- Original Message ----
From: Maarten Coene <maarten_coene@yahoo.com>
To: ivy-user@ant.apache.org
Sent: Wed, June 9, 2010 9:00:54 PM
Subject: Re: very slow dependency resolution when running ivy from gant

Could you set the Ivy loglevel to verbose (or debug)?
Maybe this gives more information where the slowness comes from?

Maarten




----- Original Message ----
From: Sebastian Gozin <sebastian.gozin@newtec.eu>
To: ivy-user@ant.apache.org
Sent: Wed, June 9, 2010 3:27:52 PM
Subject: very slow dependency resolution when running ivy from gant

I have a gant script which resolves an ivy.xml file with just 2 dependencies defined but a
fair amount of transitive dependencies.
These dependencies are then copied to a local folder. I did some debugging and noticed that
the actual downloading takes almost no time at all but still there is a lot of delay between
downloading of individual dependencies. Almost like parsing the Maven pom files is very slow
(speculation).

To give an indication of how bad it is if I delete the .ivy2/cache folder and run the task
again it takes around 15 minutes just to get to the point where ivy actually downloads the
dependencies.

Has anyone observed this problem before? Any ideas?
I can reproduce this on pretty much any system going from ubuntu, fedora, centos, osx. Only
thing I didn't try was windows.

gant task definition:
target('get-dependencies':'Install dependencies') {
        def lib = new File("lib")
        lib.mkdirs()

        ivy.settings(file:"${System.getProperty('user.home')}/.ivy2/ivysettings-newtec.xml")
        ivy.resolve(file:'ivy.xml')
        ivy.retrieve(pattern:"$lib.absolutePath/[artifact].[ext]")
}

stdout log:
03-May-2010 08:44:26      get-dependencies:
03-May-2010 08:44:26     Clearing old library folder /home/bob/bamboo-agent-home/xml-data/build-dir/S3PVAL-S3PVT/lib...
done!
03-May-2010 08:44:27     Copying libraries to /home/bob/bamboo-agent-home/xml-data/build-dir/S3PVAL-S3PVT/lib...::
Ivy 2.1.0 - 20090925235825 :: http://ant.apache.org/ivy/ ::
03-May-2010 08:44:27     [antlib:org.apache.ivy.ant:resolve] :: loading settings :: file =
/home/bob/.ivy2/ivysettings-newtec.xml
03-May-2010 08:44:27     [antlib:org.apache.ivy.ant:resolve] :: resolving dependencies ::
ntc.val.sat3play-tests#sat3play-tests;working@valautm.build.eng-it.newtec.be
03-May-2010 08:44:27     [antlib:org.apache.ivy.ant:resolve]         confs: [build, compile,
test, runtime]
03-May-2010 08:45:06     [antlib:org.apache.ivy.ant:resolve]         found commons-lang#commons-lang;2.4
in maven-newtec
03-May-2010 08:45:52     [antlib:org.apache.ivy.ant:resolve]         found ntc.val.sat3play-tests#sat3play-tests-jar;1.2.2-RC3
in maven-newtec
03-May-2010 08:46:32     [antlib:org.apache.ivy.ant:resolve]         found ntc.nms.sat3play#cli-resource-scripts-jar;2.0.11
in maven-newtec
03-May-2010 08:46:33     [antlib:org.apache.ivy.ant:resolve]         found org.easyb#easyb;0.9.6
in maven-newtec
03-May-2010 08:46:33     [antlib:org.apache.ivy.ant:resolve]         found commons-cli#commons-cli;1.1
in maven-newtec
03-May-2010 08:46:33     [antlib:org.apache.ivy.ant:resolve]         found ntc.nms.sat3play.cmt#co-cmt-interface;2.0.10
in maven-newtec
03-May-2010 08:46:33     [antlib:org.apache.ivy.ant:resolve]         found ntc.nms.datatypes#datatypes;1.0.8
in maven-newtec
03-May-2010 08:46:45     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring;2.5.5
in maven-newtec
03-May-2010 08:46:46     [antlib:org.apache.ivy.ant:resolve]         found ntc.val#cpe-portal-interface;1.0.5
in maven-newtec
03-May-2010 08:47:23     [antlib:org.apache.ivy.ant:resolve]         found org.grails#grails-spring;1.2.0
in maven-newtec
03-May-2010 08:47:50     [antlib:org.apache.ivy.ant:resolve]         found org.slf4j#jcl-over-slf4j;1.5.8
in maven-newtec
03-May-2010 08:48:02     [antlib:org.apache.ivy.ant:resolve]         found org.slf4j#slf4j-api;1.5.8
in maven-newtec
03-May-2010 08:48:14     [antlib:org.apache.ivy.ant:resolve]         found org.slf4j#jul-to-slf4j;1.5.8
in maven-newtec
03-May-2010 08:48:46     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-core;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:48:57     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-asm;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:49:10     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-beans;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:49:22     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-context;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:49:35     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-expression;3.0.0.RELEASE
in maven-newtec
03-May-2010 08:49:47     [antlib:org.apache.ivy.ant:resolve]         found org.slf4j#slf4j-log4j12;1.5.8
in maven-newtec
03-May-2010 08:49:57     [antlib:org.apache.ivy.ant:resolve]         found log4j#log4j;1.2.14
in maven-newtec
03-May-2010 08:49:58     [antlib:org.apache.ivy.ant:resolve]         found org.codehaus.groovy#groovy-all;1.7.1
in maven-newtec
03-May-2010 08:50:09     [antlib:org.apache.ivy.ant:resolve]         found jline#jline;0.9.94
in maven-newtec
03-May-2010 08:50:41     [antlib:org.apache.ivy.ant:resolve]         found org.codehaus.gant#gant_groovy1.6;1.7.0
in maven-newtec
03-May-2010 08:50:54     [antlib:org.apache.ivy.ant:resolve]         found commons-cli#commons-cli;1.2
in maven-newtec
03-May-2010 08:51:17     [antlib:org.apache.ivy.ant:resolve]         found org.apache.ant#ant;1.7.1
in maven-newtec
03-May-2010 08:51:45     [antlib:org.apache.ivy.ant:resolve]         found org.apache.ant#ant-launcher;1.7.1
in maven-newtec
03-May-2010 08:52:10     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-ant-tasks;2.0.10
in maven-newtec
03-May-2010 08:52:34     [antlib:org.apache.ivy.ant:resolve]         found classworlds#classworlds;1.1-alpha-2
in maven-newtec
03-May-2010 08:52:58     [antlib:org.apache.ivy.ant:resolve]         found org.codehaus.plexus#plexus-container-default;1.0-alpha-9-stable-1
in maven-newtec
03-May-2010 08:53:10     [antlib:org.apache.ivy.ant:resolve]         found org.codehaus.plexus#plexus-utils;1.5.5
in maven-newtec
03-May-2010 08:53:35     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-artifact;2.0.10
in maven-newtec
03-May-2010 08:53:35     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-artifact-manager;2.0.10
in maven-newtec
03-May-2010 08:53:35     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-repository-metadata;2.0.10
in maven-newtec
03-May-2010 08:54:20     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven.wagon#wagon-provider-api;1.0-beta-2
in maven-newtec
03-May-2010 08:54:20     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-model;2.0.10
in maven-newtec
03-May-2010 08:54:20     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-project;2.0.10
in maven-newtec
03-May-2010 08:54:20     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-settings;2.0.10
in maven-newtec
03-May-2010 08:54:20     [antlib:org.apache.ivy.ant:resolve]         found org.codehaus.plexus#plexus-interpolation;1.1
in maven-newtec
03-May-2010 08:54:20     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-profile;2.0.10
in maven-newtec
03-May-2010 08:54:21     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-plugin-registry;2.0.10
in maven-newtec
03-May-2010 08:54:21     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven#maven-error-diagnostics;2.0.10
in maven-newtec
03-May-2010 08:54:36     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven.wagon#wagon-file;1.0-beta-2
in maven-newtec
03-May-2010 08:54:36     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven.wagon#wagon-http-lightweight;1.0-beta-2
in maven-newtec
03-May-2010 08:54:36     [antlib:org.apache.ivy.ant:resolve]         found org.apache.maven.wagon#wagon-http-shared;1.0-beta-2
in maven-newtec
03-May-2010 08:54:36     [antlib:org.apache.ivy.ant:resolve]         found org.apache.ivy#ivy;2.1.0-rc2
in maven-newtec
03-May-2010 08:55:01     [antlib:org.apache.ivy.ant:resolve]         found org.apache.ant#ant-jsch;1.7.1
in maven-newtec
03-May-2010 08:55:13     [antlib:org.apache.ivy.ant:resolve]         found com.jcraft#jsch;0.1.29
in maven-newtec
03-May-2010 08:55:13     [antlib:org.apache.ivy.ant:resolve] jsch#jsch;0.1.29 is relocated
to com.jcraft#jsch;0.1.29. Please update your dependencies.
03-May-2010 08:55:13     [antlib:org.apache.ivy.ant:resolve]         found jsch#jsch;0.1.29
in maven-newtec
03-May-2010 08:55:25     [antlib:org.apache.ivy.ant:resolve]         found joda-time#joda-time;1.4
in maven-newtec
03-May-2010 08:55:41     [antlib:org.apache.ivy.ant:resolve]         found org.springframework.ws#spring-ws-core;1.5.8
in maven-newtec
03-May-2010 08:55:41     [antlib:org.apache.ivy.ant:resolve]         found org.springframework.ws#spring-xml;1.5.8
in maven-newtec
03-May-2010 08:55:41     [antlib:org.apache.ivy.ant:resolve]         found org.springframework.ws#spring-oxm;1.5.8
in maven-newtec
03-May-2010 08:55:54     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-aop;2.5.6
in maven-newtec
03-May-2010 08:56:07     [antlib:org.apache.ivy.ant:resolve]         found aopalliance#aopalliance;1.0
in maven-newtec
03-May-2010 08:56:18     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-web;2.5.6
in maven-newtec
03-May-2010 08:56:30     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-webmvc;2.5.6
in maven-newtec
03-May-2010 08:56:45     [antlib:org.apache.ivy.ant:resolve]         found org.springframework#spring-context-support;2.5.6
in maven-newtec
03-May-2010 08:56:45     [antlib:org.apache.ivy.ant:resolve]         found wsdl4j#wsdl4j;1.6.1
in maven-newtec
03-May-2010 08:57:14     [antlib:org.apache.ivy.ant:resolve]         found org.codehaus.gpars#gpars;0.9
in maven-newtec
03-May-2010 08:58:06     [antlib:org.apache.ivy.ant:resolve]         found org.coconut.forkjoin#jsr166y;070108
in maven-newtec
03-May-2010 08:58:18     [antlib:org.apache.ivy.ant:resolve]         found org.jboss.netty#netty;3.1.5.GA
in maven-newtec
03-May-2010 08:58:29     [antlib:org.apache.ivy.ant:resolve]         found net.sourceforge.htmlunit#htmlunit;2.7
in maven-newtec
03-May-2010 08:58:41     [antlib:org.apache.ivy.ant:resolve]         found xalan#xalan;2.7.1
in maven-newtec
03-May-2010 08:59:06     [antlib:org.apache.ivy.ant:resolve]         found xalan#serializer;2.7.1
in maven-newtec
03-May-2010 08:59:07     [antlib:org.apache.ivy.ant:resolve]         found commons-collections#commons-collections;3.2.1
in maven-newtec
03-May-2010 08:59:20     [antlib:org.apache.ivy.ant:resolve]         found commons-httpclient#commons-httpclient;3.1
in maven-newtec
03-May-2010 08:59:21     [antlib:org.apache.ivy.ant:resolve]         found commons-codec#commons-codec;1.4
in maven-newtec
03-May-2010 08:59:32     [antlib:org.apache.ivy.ant:resolve]         found net.sourceforge.htmlunit#htmlunit-core-js;2.7
in maven-newtec
03-May-2010 08:59:58     [antlib:org.apache.ivy.ant:resolve]         found xerces#xercesImpl;2.9.1
in maven-newtec
03-May-2010 08:59:58     [antlib:org.apache.ivy.ant:resolve]         found net.sourceforge.nekohtml#nekohtml;1.9.14
in maven-newtec
03-May-2010 09:00:17     [antlib:org.apache.ivy.ant:resolve]         found net.sourceforge.cssparser#cssparser;0.9.5
in maven-newtec
03-May-2010 09:00:30     [antlib:org.apache.ivy.ant:resolve]         found org.w3c.css#sac;1.3
in maven-newtec
03-May-2010 09:00:42     [antlib:org.apache.ivy.ant:resolve]         found commons-io#commons-io;1.4
in maven-newtec
03-May-2010 09:00:42     [antlib:org.apache.ivy.ant:resolve] downloading http://archiva.eng-it.newtec.be/repository/ntc-repo/commons-lang/commons-lang/2.4/commons-lang-2.4.jar
...
03-May-2010 09:00:42     [antlib:org.apache.ivy.ant:resolve] ....................................................................................................
(255kB)


Newtec’s MENOS system awarded IBC Innovation Award for Content Delivery & the IBC Judges’
Award  Newtec’s FlexACM awarded 2009 Teleport Technology of the Year by WTA  *** e-mail
confidentiality footer *** This message and any attachments thereto are confidential. They
may also be privileged or otherwise protected by work product immunity or other legal rules.
If you have received it by mistake, please let us know by e-mail reply and delete it from
your system; you may not copy this message or disclose its contents to anyone. E-mail transmission
cannot be guaranteed to be secure or error free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore is in
no way liable for any errors or omissions in the content of this message, which may arise
as a result of e-mail transmission. If verification is required, please request a hard copy.





Newtec’s MENOS system awarded IBC Innovation Award for Content Delivery & the IBC Judges’
Award  Newtec’s FlexACM awarded 2009 Teleport Technology of the Year by WTA  *** e-mail
confidentiality footer *** This message and any attachments thereto are confidential. They
may also be privileged or otherwise protected by work product immunity or other legal rules.
If you have received it by mistake, please let us know by e-mail reply and delete it from
your system; you may not copy this message or disclose its contents to anyone. E-mail transmission
cannot be guaranteed to be secure or error free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore is in
no way liable for any errors or omissions in the content of this message, which may arise
as a result of e-mail transmission. If verification is required, please request a hard copy.

Mime
View raw message