Return-Path: Delivered-To: apmail-ant-notifications-archive@minotaur.apache.org Received: (qmail 66243 invoked from network); 3 Jun 2010 10:00:25 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 3 Jun 2010 10:00:25 -0000 Received: (qmail 22363 invoked by uid 500); 3 Jun 2010 10:00:25 -0000 Delivered-To: apmail-ant-notifications-archive@ant.apache.org Received: (qmail 22009 invoked by uid 500); 3 Jun 2010 10:00:23 -0000 Mailing-List: contact notifications-help@ant.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ant.apache.org Delivered-To: mailing list notifications@ant.apache.org Received: (qmail 20953 invoked by uid 99); 3 Jun 2010 10:00:22 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jun 2010 10:00:22 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Jun 2010 10:00:18 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o539xu1E021780 for ; Thu, 3 Jun 2010 09:59:56 GMT Message-ID: <11145280.155101275559196760.JavaMail.jira@thor> Date: Thu, 3 Jun 2010 05:59:56 -0400 (EDT) From: "Maarten Coene (JIRA)" To: notifications@ant.apache.org Subject: [jira] Commented: (IVY-1194) Downloads from maven repository fail when using transparent HTTP proxies In-Reply-To: <9846501.129691275476619034.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/IVY-1194?page=3Dcom.atlassian.j= ira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D128750= 26#action_12875026 ]=20 Maarten Coene commented on IVY-1194: ------------------------------------ I didn't had this problem when I tested it out myself (without a squid prox= y though). Is it possible that this is also squid - related? > Downloads from maven repository fail when using transparent HTTP proxies > ------------------------------------------------------------------------ > > Key: IVY-1194 > URL: https://issues.apache.org/jira/browse/IVY-1194 > Project: Ivy > Issue Type: Bug > Components: Core > Affects Versions: 2.1.0 > Environment: Windows XP, Java 1.5.0.16, java 1.6.0.20 > Reporter: Constantine Plotnikov > Assignee: Maarten Coene > Priority: Blocker > Fix For: 2.2.0-RC1 > > > The package without dependencies cannot fetch dependencies and samples in= the package with dependencies do not work. > Fetching dependencies fails with the following log: > {quote} > Buildfile: build.xml > init-ivy: > retrieve-all: > [ivy:retrieve] :: Ivy 2.1.0 - 20090925235825 :: http://ant.apache.org/ivy= / :: > [ivy:retrieve] :: loading settings :: url =3D jar:file:/C:/utils/apache/a= pache-ivy-2.1.0-wo/ivy.jar!/org/apache/ivy/core/settings/ivysettings.xml > [ivy:retrieve] :: resolving dependencies :: org.apache.ivy#ivy;2.1.0 > [ivy:retrieve] =09confs: [core, httpclient, oro, vfs, sftp, standalone, a= nt, default, test, source] > [ivy:retrieve] =09found commons-httpclient#commons-httpclient;3.0 in publ= ic > [ivy:retrieve] =09found commons-codec#commons-codec;1.2 in public > [ivy:retrieve] =09found oro#oro;2.0.8 in public > [ivy:retrieve] =09found commons-vfs#commons-vfs;1.0 in public > [ivy:retrieve] =09found com.jcraft#jsch;0.1.31 in public > [ivy:retrieve] =09found ant#ant;1.6.2 in public > [ivy:retrieve] =09found ant#ant-nodeps;1.6.2 in public > [ivy:retrieve] =09found ant#ant-trax;1.6.2 in public > [ivy:retrieve] =09found junit#junit;3.8.2 in public > [ivy:retrieve] =09found commons-lang#commons-lang;2.4 in public > [ivy:retrieve] =09found org.apache.ant#ant-testutil;1.7.0 in public > [ivy:retrieve] =09found ant#ant-launcher;1.6.2 in public > [ivy:retrieve] =09found xerces#xercesImpl;2.6.2 in public > [ivy:retrieve] =09found xerces#xmlParserAPIs;2.6.2 in public > [ivy:retrieve] downloading http://repo1.maven.org/maven2/junit/junit/3.8.= 2/junit-3.8.2.jar ... > [ivy:retrieve] ............ (117kB) > [ivy:retrieve] .. (0kB) > [ivy:retrieve] :: resolution report :: resolve 1250ms :: artifacts dl 250= ms > [ivy:retrieve] =09:: evicted modules: > [ivy:retrieve] =09commons-logging#commons-logging;1.0.3 by [commons-loggi= ng#commons-logging;1.0.4] in [default] > =09--------------------------------------------------------------------- > =09| | modules || artifacts | > =09| conf | number| search|dwnlded|evicted|| number|dwnlded| > =09--------------------------------------------------------------------- > =09| core | 0 | 0 | 0 | 0 || 0 | 0 | > =09| httpclient | 3 | 0 | 0 | 0 || 2 | 0 | > =09| oro | 1 | 0 | 0 | 0 || 1 | 0 | > =09| vfs | 2 | 0 | 0 | 0 || 1 | 0 | > =09| sftp | 1 | 0 | 0 | 0 || 1 | 0 | > =09| standalone | 0 | 0 | 0 | 0 || 0 | 0 | > =09| ant | 1 | 0 | 0 | 0 || 1 | 0 | > =09| default | 10 | 0 | 0 | 1 || 8 | 0 | > =09| test | 6 | 0 | 0 | 0 || 6 | 0 | > =09| source | 0 | 0 | 0 | 0 || 0 | 0 | > =09--------------------------------------------------------------------- > [ivy:retrieve] :: problems summary :: > [ivy:retrieve] :::: WARNINGS > [ivy:retrieve] =09problem while downloading module descriptor: http://rep= o1.maven.org/maven2/commons-logging/commons-logging/1.0.3/commons-logging-1= .0.3.pom: invalid sha1: expected=3D< > [ivy:retrieve] =D0=B3 computed=3D88c58ea4a562116ab15fb76c9097ee1f25cc750b= (62ms) > [ivy:retrieve] =09=09module not found: commons-logging#commons-logging;1.= 0.3 > [ivy:retrieve] =09=3D=3D=3D=3D local: tried > [ivy:retrieve] =09 C:\Documents and Settings\Constantin.Plotnikov\.ivy2/= local/commons-logging/commons-logging/1.0.3/ivys/ivy.xml > [ivy:retrieve] =09 -- artifact commons-logging#commons-logging;1.0.3!com= mons-logging.jar: > [ivy:retrieve] =09 C:\Documents and Settings\Constantin.Plotnikov\.ivy2/= local/commons-logging/commons-logging/1.0.3/jars/commons-logging.jar > [ivy:retrieve] =09=3D=3D=3D=3D shared: tried > [ivy:retrieve] =09 C:\Documents and Settings\Constantin.Plotnikov\.ivy2/= shared/commons-logging/commons-logging/1.0.3/ivys/ivy.xml > [ivy:retrieve] =09 -- artifact commons-logging#commons-logging;1.0.3!com= mons-logging.jar: > [ivy:retrieve] =09 C:\Documents and Settings\Constantin.Plotnikov\.ivy2/= shared/commons-logging/commons-logging/1.0.3/jars/commons-logging.jar > [ivy:retrieve] =09=3D=3D=3D=3D public: tried > [ivy:retrieve] =09 http://repo1.maven.org/maven2/commons-logging/commons= -logging/1.0.3/commons-logging-1.0.3.pom > [ivy:retrieve] =09problem while downloading module descriptor: http://rep= o1.maven.org/maven2/commons-logging/commons-logging/1.0.4/commons-logging-1= .0.4.pom: invalid sha1: expected=3D< > [ivy:retrieve] =09=09module not found: commons-logging#commons-logging;1.= 0.4 > [ivy:retrieve] =09=3D=3D=3D=3D local: tried > [ivy:retrieve] =09 C:\Documents and Settings\Constantin.Plotnikov\.ivy2/= local/commons-logging/commons-logging/1.0.4/ivys/ivy.xml > [ivy:retrieve] =09 -- artifact commons-logging#commons-logging;1.0.4!com= mons-logging.jar: > [ivy:retrieve] =09 C:\Documents and Settings\Constantin.Plotnikov\.ivy2/= local/commons-logging/commons-logging/1.0.4/jars/commons-logging.jar > [ivy:retrieve] =09=3D=3D=3D=3D shared: tried > [ivy:retrieve] =09 C:\Documents and Settings\Constantin.Plotnikov\.ivy2/= shared/commons-logging/commons-logging/1.0.4/ivys/ivy.xml > [ivy:retrieve] =09 -- artifact commons-logging#commons-logging;1.0.4!com= mons-logging.jar: > [ivy:retrieve] =09 C:\Documents and Settings\Constantin.Plotnikov\.ivy2/= shared/commons-logging/commons-logging/1.0.4/jars/commons-logging.jar > [ivy:retrieve] =09=3D=3D=3D=3D public: tried > [ivy:retrieve] =09 http://repo1.maven.org/maven2/commons-logging/commons= -logging/1.0.4/commons-logging-1.0.4.pom > [ivy:retrieve] =09=09[FAILED ] junit#junit;3.8.2!junit.jar: invalid s= ha1: expected=3D< > [ivy:retrieve] =09=09[FAILED ] junit#junit;3.8.2!junit.jar: (0ms) > [ivy:retrieve] =09=3D=3D=3D=3D shared: tried > [ivy:retrieve] =09 C:\Documents and Settings\Constantin.Plotnikov\.ivy2/= shared/junit/junit/3.8.2/jars/junit.jar > [ivy:retrieve] =09=3D=3D=3D=3D public: tried > [ivy:retrieve] =09 http://repo1.maven.org/maven2/junit/junit/3.8.2/junit= -3.8.2.jar > [ivy:retrieve] =09=09:::::::::::::::::::::::::::::::::::::::::::::: > [ivy:retrieve] =09=09:: UNRESOLVED DEPENDENCIES :: > [ivy:retrieve] =09=09:::::::::::::::::::::::::::::::::::::::::::::: > [ivy:retrieve] =09=09:: commons-logging#commons-logging;1.0.3: not found > [ivy:retrieve] =09=09:: commons-logging#commons-logging;1.0.4: not found > [ivy:retrieve] =09=09:::::::::::::::::::::::::::::::::::::::::::::: > [ivy:retrieve]=20 > [ivy:retrieve] =09=09:::::::::::::::::::::::::::::::::::::::::::::: > [ivy:retrieve] =09=09:: FAILED DOWNLOADS :: > [ivy:retrieve] =09=09:: ^ see resolution messages for details ^ :: > [ivy:retrieve] =09=09:::::::::::::::::::::::::::::::::::::::::::::: > [ivy:retrieve] =09=09:: junit#junit;3.8.2!junit.jar > [ivy:retrieve] =09=09:::::::::::::::::::::::::::::::::::::::::::::: > [ivy:retrieve]=20 > [ivy:retrieve]=20 > [ivy:retrieve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS > {quote} > The sample in package with dependencies fails with the following log: > {quote} > Buildfile: build.xml > download-ivy: > [mkdir] Created dir: C:\utils\apache\apache-ivy-2.1.0\src\example\go-= ivy\ivy > [echo] installing ivy... > [get] Getting: http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.1= .0/ivy-2.1.0.jar > [get] To: C:\utils\apache\apache-ivy-2.1.0\src\example\go-ivy\ivy\i= vy.jar > install-ivy: > [taskdef] java.util.zip.ZipException: error in opening zip file > [taskdef] =09at java.util.zip.ZipFile.open(Native Method) > [taskdef] =09at java.util.zip.ZipFile.(ZipFile.java:203) > [taskdef] =09at java.util.zip.ZipFile.(ZipFile.java:234) > [taskdef] =09at org.apache.tools.ant.AntClassLoader.getResourceURL(AntC= lassLoader.java:919) > [taskdef] =09at org.apache.tools.ant.AntClassLoader$ResourceEnumeration= .findNextResource(AntClassLoader.java:126) > [taskdef] =09at org.apache.tools.ant.AntClassLoader$ResourceEnumeration= .(AntClassLoader.java:88) > [taskdef] =09at org.apache.tools.ant.AntClassLoader.findResources(AntCl= assLoader.java:869) > [taskdef] =09at java.lang.ClassLoader.getResources(ClassLoader.java:101= 5) > [taskdef] =09at org.apache.tools.ant.taskdefs.Definer.resourceToURLs(De= finer.java:267) > [taskdef] =09at org.apache.tools.ant.taskdefs.Definer.execute(Definer.j= ava:211) > [taskdef] =09at org.apache.tools.ant.UnknownElement.execute(UnknownElem= ent.java:275) > [taskdef] =09at org.apache.tools.ant.Task.perform(Task.java:364) > [taskdef] =09at org.apache.tools.ant.Target.execute(Target.java:341) > [taskdef] =09at org.apache.tools.ant.Target.performTasks(Target.java:36= 9) > [taskdef] =09at org.apache.tools.ant.Project.executeSortedTargets(Proje= ct.java:1216) > [taskdef] =09at org.apache.tools.ant.Project.executeTarget(Project.java= :1185) > [taskdef] =09at org.apache.tools.ant.helper.DefaultExecutor.executeTarg= ets(DefaultExecutor.java:40) > [taskdef] =09at org.apache.tools.ant.Project.executeTargets(Project.jav= a:1068) > [taskdef] =09at org.apache.tools.ant.Main.runBuild(Main.java:668) > [taskdef] =09at org.apache.tools.ant.Main.startAnt(Main.java:187) > [taskdef] =09at org.apache.tools.ant.launch.Launcher.run(Launcher.java:= 246) > [taskdef] =09at org.apache.tools.ant.launch.Launcher.main(Launcher.java= :67) > [taskdef] Could not load definitions from resource org/apache/ivy/ant/a= ntlib.xml. It could not be found. > generate-src: > go: > [echo] using ivy to resolve commons-lang 2.1... > BUILD FAILED > C:\utils\apache\apache-ivy-2.1.0\src\example\go-ivy\build.xml:85: Could n= ot create task or type of type: antlib:org.apache.ivy.ant:cachepath. > Ant could not find the task or a class this task relies upon. > This is common and has a number of causes; the usual=20 > solutions are to read the manual pages then download and > install needed JAR files, or fix the build file:=20 > - You have misspelt 'antlib:org.apache.ivy.ant:cachepath'. > Fix: check your spelling. > - The task needs an external JAR file to execute > and this is not found at the right place in the classpath. > Fix: check the documentation for dependencies. > Fix: declare the task. > - The task is an Ant optional task and the JAR file and/or libraries > implementing the functionality were not found at the time you > yourself built your installation of Ant from the Ant sources. > Fix: Look in the ANT_HOME/lib for the 'ant-' JAR corresponding to the > task and make sure it contains more than merely a META-INF/MANIFEST.= MF. > If all it contains is the manifest, then rebuild Ant with the needed > libraries present in ${ant.home}/lib/optional/ , or alternatively, > download a pre-built release version from apache.org > - The build file was written for a later version of Ant > Fix: upgrade to at least the latest release version of Ant > - The task is not an Ant core or optional task=20 > and needs to be declared using . > - You are attempting to use a task defined using=20 > or but have spelt wrong or not=20 > defined it at the point of use > Remember that for JAR files to be visible to Ant tasks implemented > in ANT_HOME/lib, the files must be in the same directory or on the > classpath > Please neither file bug reports on this problem, nor email the > Ant mailing lists, until all of these causes have been explored, > as this is not an Ant bug. > Total time: 1 second > {quote} > The reason for the bug is the squid. When request comes and it has a cach= ed content with gzip content encoding, it return a content with encoded con= tent, event if no encoding was specified in the request or "Accept-Encoding= : identity" was specified. The below is a sample log that demonstrates the = problem: =20 > {quote} > DEBUG output created by Wget 1.11.4 on cygwin. > --2010-06-02 12:41:55-- http://repo1.maven.org/maven2/org/apache/ivy/ivy= /2.1.0/ivy-2.1.0.jar > Resolving repo1.maven.org... 38.97.124.18 > Caching repo1.maven.org =3D> 38.97.124.18 > Connecting to repo1.maven.org|38.97.124.18|:80... connected. > Created socket 4. > Releasing 0x006d9100 (new refcount 1). > ---request begin--- > GET /maven2/org/apache/ivy/ivy/2.1.0/ivy-2.1.0.jar HTTP/1.0 > User-Agent: Wget/1.11.4 > Accept: */* > Host: repo1.maven.org > Connection: Keep-Alive > ---request end--- > HTTP request sent, awaiting response...=20 > ---response begin--- > HTTP/1.0 200 OK > Server: nginx/0.7.62 > Date: Tue, 01 Jun 2010 13:09:36 GMT > Content-Type: application/java-archive > Last-Modified: Mon, 12 Oct 2009 21:19:02 GMT > Content-Encoding: gzip > X-Cache: MISS from squid_havp_node1 > X-Cache-Lookup: MISS from squid_havp_node1:3128 > Age: 70339 > Content-Length: 834513 > X-Cache: HIT from squid_havp_node1 > X-Cache-Lookup: HIT from squid_havp_node1:3128 > Connection: keep-alive > ---response end--- > HTTP/1.0 200 OK > Server: nginx/0.7.62 > Date: Tue, 01 Jun 2010 13:09:36 GMT > Content-Type: application/java-archive > Last-Modified: Mon, 12 Oct 2009 21:19:02 GMT > Content-Encoding: gzip > X-Cache: MISS from squid_havp_node1 > X-Cache-Lookup: MISS from squid_havp_node1:3128 > Age: 70339 > Content-Length: 834513 > X-Cache: HIT from squid_havp_node1 > X-Cache-Lookup: HIT from squid_havp_node1:3128 > Connection: keep-alive > Registered socket 4 for persistent reuse. > Length: 834513 (815K) [application/java-archive] > Saving to: `ivy-2.1.0.jar' > 0K .......... .......... .......... .......... .......... 6% 8.49M = 0s > 50K .......... .......... .......... .......... .......... 12% 12.0M = 0s > 100K .......... .......... .......... .......... .......... 18% 7.26M = 0s > 150K .......... .......... .......... .......... .......... 24% 9.28M = 0s > 200K .......... .......... .......... .......... .......... 30% 5.33M = 0s > 250K .......... .......... .......... .......... .......... 36% 9.31M = 0s > 300K .......... .......... .......... .......... .......... 42% 5.26M = 0s > 350K .......... .......... .......... .......... .......... 49% 9.15M = 0s > 400K .......... .......... .......... .......... .......... 55% 7.27M = 0s > 450K .......... .......... .......... .......... .......... 61% 7.42M = 0s > 500K .......... .......... .......... .......... .......... 67% 9.21M = 0s > 550K .......... .......... .......... .......... .......... 73% 6.11M = 0s > 600K .......... .......... .......... .......... .......... 79% 9.50M = 0s > 650K .......... .......... .......... .......... .......... 85% 8.84M = 0s > 700K .......... .......... .......... .......... .......... 92% 9.54M = 0s > 750K .......... .......... .......... .......... .......... 98% 6.04M = 0s > 800K .......... .... 100% 16.2K= =3D1.0s > 2010-06-02 12:41:56 (795 KB/s) - `ivy-2.1.0.jar' saved [834513/834513] > {quote} > In our environment, a bunch of files from repo1.maven.org are cached in t= he squid. So there were a lot of conflicts with content encoding. > The possible workarounds: > 1. Check returned content encoding from http client, if it is not identit= y, reissue the request with disabling the caches. > 2. Ungzip files fetched with gzip content encoding. > 3. Support gzip content encoding in common HTTP. > 3. Use local maven proxies=20 --=20 This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.