Return-Path: Delivered-To: apmail-hadoop-mapreduce-dev-archive@minotaur.apache.org Received: (qmail 46616 invoked from network); 18 Mar 2010 07:34:02 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 18 Mar 2010 07:34:02 -0000 Received: (qmail 94883 invoked by uid 500); 18 Mar 2010 07:33:59 -0000 Delivered-To: apmail-hadoop-mapreduce-dev-archive@hadoop.apache.org Received: (qmail 94655 invoked by uid 500); 18 Mar 2010 07:33:58 -0000 Mailing-List: contact mapreduce-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-dev@hadoop.apache.org Delivered-To: mailing list mapreduce-dev@hadoop.apache.org Received: (qmail 94647 invoked by uid 99); 18 Mar 2010 07:33:57 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Mar 2010 07:33:57 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=10.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of rodrigo@facebook.com designates 69.63.179.25 as permitted sender) Received: from [69.63.179.25] (HELO mailout-sf2p.facebook.com) (69.63.179.25) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Mar 2010 07:33:51 +0000 Received: from mail.thefacebook.com ([192.168.18.104]) by pp02.snc1.tfbnw.net (8.14.3/8.14.3) with ESMTP id o2I7Wr0A012841 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=NOT) for ; Thu, 18 Mar 2010 00:32:58 -0700 Received: from SC-MBXC1.TheFacebook.com ([192.168.18.102]) by sc-hub01.TheFacebook.com ([192.168.18.104]) with mapi; Thu, 18 Mar 2010 00:31:18 -0700 From: Rodrigo Schmidt To: "mapreduce-dev@hadoop.apache.org" Date: Thu, 18 Mar 2010 00:31:02 -0700 Subject: Re: Building offline Thread-Topic: Building offline Thread-Index: AcrGZCm9q6B4WKNwSnag74Mg/PITpQACMxKU Message-ID: In-Reply-To: <1e92a23c1003172327h697af68eo8b205be4d430255b@mail.gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-Entourage/13.3.0.091002 acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=fsecure engine=1.12.8161:2.4.5,1.2.40,4.0.166 definitions=2010-03-18_05:2010-02-06,2010-03-18,2010-03-17 signatures=0 X-Virus-Checked: Checked by ClamAV on apache.org Thanks Chaitanya! Didn't work at first. I tried many times in different ways, connected to th= e Internet and not. When I was about to give up I realized ivy might be caching some stuff, which turned out to be true. I had to delete the hadoop-core.jar file insid= e ~/ivy2/cache for it to work. This whole ivy2 and maven dependencies look too complicated for offline use and cross-project debugging. Isn't there an easier way to do things? Cheers, Rodrigo On 3/17/10 11:27 PM, "chaitanya krishna" wrote: > In case you want to use hadoop-core.jar containing your modifications in > common, i think the following works: > > 1. ant mvn-install in common project. This will create hadoop-core.jar an= d > installs it in the local m2 repository. > 2. ant test -Dresolvers=3Dinternal in mapreduce project. This will make s= ure > that the hadoop-core.jar is taken from local m2 repository. > > Hope this helps. > > -Chaitanya. > > On Thu, Mar 18, 2010 at 11:53 AM, Rodrigo Schmidt w= rote: > >> >> I tried that but my logs still didn't show up. To test if it really work= ed, >> I disabled my Internet connection and tried it, which failed. Did I miss >> anything? >> >> >> Output below: >> >> >> $ant -Doffline=3Dyes test >> Buildfile: build.xml >> >> ivy-download: >> >> ivy-init-dirs: >> >> ivy-probe-antlib: >> >> ivy-init-antlib: >> >> ivy-init: >> [ivy:configure] :: Ivy 2.0.0-rc2 - 20081028224207 :: >> http://ant.apache.org/ivy/ :: >> :: loading settings :: file =3D >> /Users/rschmidt/workspace/hadoop-mapreduce-trunk/ivy/ivysettings.xml >> >> ivy-resolve-common: >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] You probably access the destination server through a proxy >> server that is not well configured. >> [ivy:resolve] >> [ivy:resolve] :: problems summary :: >> [ivy:resolve] :::: WARNINGS >> [ivy:resolve] Host repository.apache.org not found. >> url=3D >> https://repository.apache.org/content/repositories/snapshots/org/apache/ >> hadoop/hadoop-core/0.22.0-SNAPSHOT/maven-metadata.xml> he.org/content/repositories/snapshots/org/apache/%0Ahadoop/hadoop-core/0= .22.0 >> -SNAPSHOT/maven-metadata.xml> >> [ivy:resolve] Host repository.apache.org not found. >> url=3D >> https://repository.apache.org/content/repositories/snapshots/org/apache/ >> hadoop/hadoop-core/0.22.0-SNAPSHOT/hadoop-core-0.22.0-SNAPSHOT.pom> pository.apache.org/content/repositories/snapshots/org/apache/%0Ahadoop/= hadoo >> p-core/0.22.0-SNAPSHOT/hadoop-core-0.22.0-SNAPSHOT.pom> >> [ivy:resolve] Host repository.apache.org not found. >> url=3D >> https://repository.apache.org/content/repositories/snapshots/org/apache/ >> hadoop/hadoop-core/0.22.0-SNAPSHOT/hadoop-core-0.22.0-SNAPSHOT.jar> pository.apache.org/content/repositories/snapshots/org/apache/%0Ahadoop/= hadoo >> p-core/0.22.0-SNAPSHOT/hadoop-core-0.22.0-SNAPSHOT.jar> >> [ivy:resolve] Host repo1.maven.org not found. >> url=3D >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.22.0-SNAPS >> HOT/hadoop-core-0.22.0-SNAPSHOT.pom> hadoop/hadoop-core/0.22.0-SNAPS%0AHOT/hadoop-core-0.22.0-SNAPSHOT.pom> >> [ivy:resolve] Host repo1.maven.org not found. >> url=3D >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.22.0-SNAPS >> HOT/hadoop-core-0.22.0-SNAPSHOT.jar> hadoop/hadoop-core/0.22.0-SNAPS%0AHOT/hadoop-core-0.22.0-SNAPSHOT.jar> >> [ivy:resolve] module not found: >> org.apache.hadoop#hadoop-core;0.22.0-SNAPSHOT >> [ivy:resolve] =3D=3D=3D=3D apache-snapshot: tried >> [ivy:resolve] >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/= hado >> op/hadoop-core/0.22.0-SNAPSHOT/hadoop-core-0.22.0-SNAPSHOT.pom> tory.apache.org/content/repositories/snapshots/org/apache/hado%0Aop/hado= op-co >> re/0.22.0-SNAPSHOT/hadoop-core-0.22.0-SNAPSHOT.pom> >> [ivy:resolve] -- artifact >> org.apache.hadoop#hadoop-core;0.22.0-SNAPSHOT!hadoop-core.jar: >> [ivy:resolve] >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/= hado >> op/hadoop-core/0.22.0-SNAPSHOT/hadoop-core-0.22.0-SNAPSHOT.jar> tory.apache.org/content/repositories/snapshots/org/apache/hado%0Aop/hado= op-co >> re/0.22.0-SNAPSHOT/hadoop-core-0.22.0-SNAPSHOT.jar> >> [ivy:resolve] =3D=3D=3D=3D maven2: tried >> [ivy:resolve] >> >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.22.0-SNAPS= HOT/ >> hadoop-core-0.22.0-SNAPSHOT.pom> op/hadoop-core/0.22.0-SNAPSHOT/%0Ahadoop-core-0.22.0-SNAPSHOT.pom> >> [ivy:resolve] -- artifact >> org.apache.hadoop#hadoop-core;0.22.0-SNAPSHOT!hadoop-core.jar: >> [ivy:resolve] >> >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.22.0-SNAPS= HOT/ >> hadoop-core-0.22.0-SNAPSHOT.jar> op/hadoop-core/0.22.0-SNAPSHOT/%0Ahadoop-core-0.22.0-SNAPSHOT.jar> >> [ivy:resolve] Host repository.apache.org not found. >> url=3D >> https://repository.apache.org/content/repositories/snapshots/org/apache/ >> hadoop/hadoop-core-test/0.22.0-SNAPSHOT/maven-metadata.xml> .apache.org/content/repositories/snapshots/org/apache/%0Ahadoop/hadoop-c= ore-t >> est/0.22.0-SNAPSHOT/maven-metadata.xml> >> [ivy:resolve] Host repository.apache.org not found. >> url=3D >> https://repository.apache.org/content/repositories/snapshots/org/apache/ >> >> hadoop/hadoop-core-test/0.22.0-SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT= .pom< >> https://repository.apache.org/content/repositories/snapshots/org/apache/= %0Aha >> doop/hadoop-core-test/0.22.0-SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT.p= om> >> [ivy:resolve] Host repository.apache.org not found. >> url=3D >> https://repository.apache.org/content/repositories/snapshots/org/apache/ >> >> hadoop/hadoop-core-test/0.22.0-SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT= .jar< >> https://repository.apache.org/content/repositories/snapshots/org/apache/= %0Aha >> doop/hadoop-core-test/0.22.0-SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT.j= ar> >> [ivy:resolve] Host repo1.maven.org not found. >> url=3D >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core-test/0.22.0- >> SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT.pom> rg/apache/hadoop/hadoop-core-test/0.22.0-%0ASNAPSHOT/hadoop-core-test-0.= 22.0- >> SNAPSHOT.pom> >> [ivy:resolve] Host repo1.maven.org not found. >> url=3D >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core-test/0.22.0- >> SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT.jar> rg/apache/hadoop/hadoop-core-test/0.22.0-%0ASNAPSHOT/hadoop-core-test-0.= 22.0- >> SNAPSHOT.jar> >> [ivy:resolve] module not found: >> org.apache.hadoop#hadoop-core-test;0.22.0-SNAPSHOT >> [ivy:resolve] =3D=3D=3D=3D apache-snapshot: tried >> [ivy:resolve] >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/= hado >> op/hadoop-core-test/0.22.0-SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT.pom= > s://repository.apache.org/content/repositories/snapshots/org/apache/hado= %0Aop >> /hadoop-core-test/0.22.0-SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT.pom> >> [ivy:resolve] -- artifact >> org.apache.hadoop#hadoop-core-test;0.22.0-SNAPSHOT!hadoop-core-test.jar: >> [ivy:resolve] >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/= hado >> op/hadoop-core-test/0.22.0-SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT.jar= > s://repository.apache.org/content/repositories/snapshots/org/apache/hado= %0Aop >> /hadoop-core-test/0.22.0-SNAPSHOT/hadoop-core-test-0.22.0-SNAPSHOT.jar> >> [ivy:resolve] =3D=3D=3D=3D maven2: tried >> [ivy:resolve] >> >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core-test/0.22.0-= SNAP >> SHOT/hadoop-core-test-0.22.0-SNAPSHOT.pom> pache/hadoop/hadoop-core-test/0.22.0-SNAP%0ASHOT/hadoop-core-test-0.22.0= -SNAP >> SHOT.pom> >> [ivy:resolve] -- artifact >> org.apache.hadoop#hadoop-core-test;0.22.0-SNAPSHOT!hadoop-core-test.jar: >> [ivy:resolve] >> >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core-test/0.22.0-= SNAP >> SHOT/hadoop-core-test-0.22.0-SNAPSHOT.jar> pache/hadoop/hadoop-core-test/0.22.0-SNAP%0ASHOT/hadoop-core-test-0.22.0= -SNAP >> SHOT.jar> >> [ivy:resolve] Host repository.apache.org not found. >> url=3D >> https://repository.apache.org/content/repositories/snapshots/org/apache/ >> hadoop/hadoop-hdfs/0.22.0-SNAPSHOT/maven-metadata.xml> he.org/content/repositories/snapshots/org/apache/%0Ahadoop/hadoop-hdfs/0= .22.0 >> -SNAPSHOT/maven-metadata.xml> >> [ivy:resolve] Host repository.apache.org not found. >> url=3D >> https://repository.apache.org/content/repositories/snapshots/org/apache/ >> hadoop/hadoop-hdfs/0.22.0-SNAPSHOT/hadoop-hdfs-0.22.0-SNAPSHOT.pom> pository.apache.org/content/repositories/snapshots/org/apache/%0Ahadoop/= hadoo >> p-hdfs/0.22.0-SNAPSHOT/hadoop-hdfs-0.22.0-SNAPSHOT.pom> >> [ivy:resolve] Host repository.apache.org not found. >> url=3D >> https://repository.apache.org/content/repositories/snapshots/org/apache/ >> hadoop/hadoop-hdfs/0.22.0-SNAPSHOT/hadoop-hdfs-0.22.0-SNAPSHOT.jar> pository.apache.org/content/repositories/snapshots/org/apache/%0Ahadoop/= hadoo >> p-hdfs/0.22.0-SNAPSHOT/hadoop-hdfs-0.22.0-SNAPSHOT.jar> >> [ivy:resolve] Host repo1.maven.org not found. >> url=3D >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.22.0-SNAPS >> HOT/hadoop-hdfs-0.22.0-SNAPSHOT.pom> hadoop/hadoop-hdfs/0.22.0-SNAPS%0AHOT/hadoop-hdfs-0.22.0-SNAPSHOT.pom> >> [ivy:resolve] Host repo1.maven.org not found. >> url=3D >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.22.0-SNAPS >> HOT/hadoop-hdfs-0.22.0-SNAPSHOT.jar> hadoop/hadoop-hdfs/0.22.0-SNAPS%0AHOT/hadoop-hdfs-0.22.0-SNAPSHOT.jar> >> [ivy:resolve] module not found: >> org.apache.hadoop#hadoop-hdfs;0.22.0-SNAPSHOT >> [ivy:resolve] =3D=3D=3D=3D apache-snapshot: tried >> [ivy:resolve] >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/= hado >> op/hadoop-hdfs/0.22.0-SNAPSHOT/hadoop-hdfs-0.22.0-SNAPSHOT.pom> tory.apache.org/content/repositories/snapshots/org/apache/hado%0Aop/hado= op-hd >> fs/0.22.0-SNAPSHOT/hadoop-hdfs-0.22.0-SNAPSHOT.pom> >> [ivy:resolve] -- artifact >> org.apache.hadoop#hadoop-hdfs;0.22.0-SNAPSHOT!hadoop-hdfs.jar: >> [ivy:resolve] >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/= hado >> op/hadoop-hdfs/0.22.0-SNAPSHOT/hadoop-hdfs-0.22.0-SNAPSHOT.jar> tory.apache.org/content/repositories/snapshots/org/apache/hado%0Aop/hado= op-hd >> fs/0.22.0-SNAPSHOT/hadoop-hdfs-0.22.0-SNAPSHOT.jar> >> [ivy:resolve] =3D=3D=3D=3D maven2: tried >> [ivy:resolve] >> >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.22.0-SNAPS= HOT/ >> hadoop-hdfs-0.22.0-SNAPSHOT.pom> op/hadoop-hdfs/0.22.0-SNAPSHOT/%0Ahadoop-hdfs-0.22.0-SNAPSHOT.pom> >> [ivy:resolve] -- artifact >> org.apache.hadoop#hadoop-hdfs;0.22.0-SNAPSHOT!hadoop-hdfs.jar: >> [ivy:resolve] >> >> http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.22.0-SNAPS= HOT/ >> hadoop-hdfs-0.22.0-SNAPSHOT.jar> op/hadoop-hdfs/0.22.0-SNAPSHOT/%0Ahadoop-hdfs-0.22.0-SNAPSHOT.jar> >> [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: >> [ivy:resolve] :: UNRESOLVED DEPENDENCIES :: >> [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: >> [ivy:resolve] :: org.apache.hadoop#hadoop-core;0.22.0-SNAPSHOT: = not >> found >> [ivy:resolve] :: >> org.apache.hadoop#hadoop-core-test;0.22.0-SNAPSHOT: >> not found >> [ivy:resolve] :: org.apache.hadoop#hadoop-hdfs;0.22.0-SNAPSHOT: = not >> found >> [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: >> [ivy:resolve] >> [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS >> >> >> >> On 3/17/10 11:14 PM, "Amar Kamat" wrote: >> >>> Use -Doffline=3Dyes switch while running the tests. >>> Amar >>> >>> On 3/18/10 11:32 AM, "Rodrigo Schmidt" wrote: >>> >>> >>> >>> How do I disable the ivy download to run unit tests? I need to replace >>> hadoop-core.jar for one I created with some extra logging to debug a un= it >> test >>> for mapreduce. >>> >>> Right now I'm just erasing some lines from build.xml, but I'm quite sur= e >> there >>> is an easier way to do that. >>> >>> Thanks, >>> Rodrigo >>> >> >>