Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 71250 invoked from network); 3 Nov 2007 05:43:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Nov 2007 05:43:55 -0000 Received: (qmail 4437 invoked by uid 500); 3 Nov 2007 05:43:14 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 4364 invoked by uid 500); 3 Nov 2007 05:43:14 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 4321 invoked by uid 99); 3 Nov 2007 05:43:14 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Nov 2007 22:43:14 -0700 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 03 Nov 2007 05:43:16 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 931D971418F for ; Fri, 2 Nov 2007 22:42:56 -0700 (PDT) Message-ID: <19175082.1194068576600.JavaMail.jira@brutus> Date: Fri, 2 Nov 2007 22:42:56 -0700 (PDT) From: "Yuri Pradkin (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Commented: (HADOOP-1773) Hadoop build (ant) hangs while setting up init target, build process hangs In-Reply-To: <9695264.1187906559588.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539798 ] Yuri Pradkin commented on HADOOP-1773: -------------------------------------- Here's what I did today: svn update rm -rf build ant -v -d What follows is the output of the last step; ant hangs after the last line. Hope this would be helpful. --------------------------------------------------------------------------- Apache Ant version 1.6.5 compiled on March 19 2007 Apache Ant version 1.6.5 compiled on March 19 2007 Buildfile: build.xml Adding reference: ant.PropertyHelper Detected Java version: 1.5 in: /usr/java/jdk1.6.0_02/jre Detected OS: Linux Adding reference: ant.ComponentHelper Setting ro project property: ant.version -> Apache Ant version 1.6.5 compiled on March 19 2007 Setting ro project property: ant.file -> /nfs/jade/vint/HADOOP/hadoop.new/build.xml Adding reference: ant.projectHelper Adding reference: ant.parsing.context Adding reference: ant.targets parsing buildfile /nfs/jade/vint/HADOOP/hadoop.new/build.xml with URI = file:///nfs/jade/vint/HADOOP/hadoop.new/build.xml Setting ro project property: ant.project.name -> Hadoop Adding reference: Hadoop Setting ro project property: ant.file.Hadoop -> /nfs/jade/vint/HADOOP/hadoop.new/build.xml Project base dir set to: /nfs/jade/vint/HADOOP/hadoop.new +Target: Adding reference: classpath Adding reference: test.classpath Adding reference: test.cluster.classpath +Target: init +Target: record-parser +Target: compile-rcc-compiler +Target: compile-core-classes +Target: compile-core-native +Target: compile-core +Target: compile-contrib +Target: compile +Target: compile-examples +Target: jar +Target: examples +Target: metrics.jar +Target: generate-test-records +Target: compile-core-test +Target: test-core +Target: test-contrib +Target: test +Target: test-cluster +Target: nightly +Target: checkstyle +Target: check-for-checkstyle +Target: findbugs +Target: check-for-findbugs +Target: javadoc +Target: default-doc +Target: package +Target: tar +Target: clean +Target: deploy-contrib +Target: clean-contrib +Target: compile-libhdfs +Target: test-libhdfs +Target: clean-libhdfs +Target: doc-libhdfs +Target: package-libhdfs +Target: create-c++-configure +Target: check-c++-makefiles +Target: create-c++-utils-makefile +Target: compile-c++-utils +Target: create-c++-pipes-makefile +Target: compile-c++-pipes +Target: compile-c++ +Target: create-c++-examples-pipes-makefile +Target: compile-c++-examples-pipes +Target: compile-c++-examples +Target: compile-ant-tasks +Target: ant-tasks +Target: clover +Target: clover.setup +Target: clover.info +Target: clover.check +Target: generate-clover-reports [property] Loading /nfs/jade/vint/HADOOP/user/build.properties [property] Unable to find property file: /nfs/jade/vint/HADOOP/user/build.properties [property] Loading /nfs/jade/vint/HADOOP/hadoop.new/build.properties [property] Unable to find property file: /nfs/jade/vint/HADOOP/hadoop.new/build.properties Setting project property: Name -> Hadoop Setting project property: name -> hadoop Setting project property: version -> 0.15.0-dev Setting project property: final.name -> hadoop-0.15.0-dev Setting project property: year -> 2006 Setting project property: libhdfs.version -> 1 Setting project property: src.dir -> /nfs/jade/vint/HADOOP/hadoop.new/src/java Setting project property: native.src.dir -> /nfs/jade/vint/HADOOP/hadoop.new/src/native Setting project property: examples.dir -> /nfs/jade/vint/HADOOP/hadoop.new/src/examples Setting project property: anttasks.dir -> /nfs/jade/vint/HADOOP/hadoop.new/src/ant Setting project property: lib.dir -> /nfs/jade/vint/HADOOP/hadoop.new/lib Setting project property: conf.dir -> /nfs/jade/vint/HADOOP/hadoop.new/conf Setting project property: docs.dir -> /nfs/jade/vint/HADOOP/hadoop.new/docs Setting project property: contrib.dir -> /nfs/jade/vint/HADOOP/hadoop.new/src/contrib Setting project property: docs.src -> /nfs/jade/vint/HADOOP/hadoop.new/src/web Setting project property: c++.src -> /nfs/jade/vint/HADOOP/hadoop.new/src/c++ Setting project property: c++.utils.src -> /nfs/jade/vint/HADOOP/hadoop.new/src/c++/utils Setting project property: c++.pipes.src -> /nfs/jade/vint/HADOOP/hadoop.new/src/c++/pipes Setting project property: c++.examples.pipes.src -> /nfs/jade/vint/HADOOP/hadoop.new/src/examples/pipes Setting project property: libhdfs.src -> /nfs/jade/vint/HADOOP/hadoop.new/src/c++/libhdfs Setting project property: build.dir -> /nfs/jade/vint/HADOOP/hadoop.new/build Setting project property: build.classes -> /nfs/jade/vint/HADOOP/hadoop.new/build/classes Setting project property: build.src -> /nfs/jade/vint/HADOOP/hadoop.new/build/src Setting project property: build.webapps -> /nfs/jade/vint/HADOOP/hadoop.new/build/webapps Setting project property: build.examples -> /nfs/jade/vint/HADOOP/hadoop.new/build/examples Setting project property: build.anttasks -> /nfs/jade/vint/HADOOP/hadoop.new/build/ant Setting project property: build.libhdfs -> /nfs/jade/vint/HADOOP/hadoop.new/build/libhdfs Setting project property: build.platform -> Linux-amd64-64 Setting project property: build.native -> /nfs/jade/vint/HADOOP/hadoop.new/build/native/Linux-amd64-64 Setting project property: build.c++ -> /nfs/jade/vint/HADOOP/hadoop.new/build/c++-build/Linux-amd64-64 Setting project property: build.c++.utils -> /nfs/jade/vint/HADOOP/hadoop.new/build/c++-build/Linux-amd64-64/utils Setting project property: build.c++.pipes -> /nfs/jade/vint/HADOOP/hadoop.new/build/c++-build/Linux-amd64-64/pipes Setting project property: build.c++.examples.pipes -> /nfs/jade/vint/HADOOP/hadoop.new/build/c++-build/Linux-amd64-64/examples/pipes Setting project property: build.docs -> /nfs/jade/vint/HADOOP/hadoop.new/build/docs Setting project property: build.javadoc -> /nfs/jade/vint/HADOOP/hadoop.new/build/docs/api Setting project property: build.encoding -> ISO-8859-1 Setting project property: install.c++ -> /nfs/jade/vint/HADOOP/hadoop.new/build/c++/Linux-amd64-64 Setting project property: install.c++.examples -> /nfs/jade/vint/HADOOP/hadoop.new/build/c++-examples/Linux-amd64-64 Setting project property: test.src.dir -> /nfs/jade/vint/HADOOP/hadoop.new/src/test Setting project property: test.build.dir -> /nfs/jade/vint/HADOOP/hadoop.new/build/test Setting project property: test.generated.dir -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/src Setting project property: test.build.data -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/data Setting project property: test.cache.data -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/cache Setting project property: test.log.dir -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/logs Setting project property: test.build.classes -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/classes Setting project property: test.build.testjar -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/testjar Setting project property: test.build.javadoc -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/docs/api Setting project property: test.include -> Test* Setting project property: test.classpath.id -> test.classpath Setting project property: test.output -> no Setting project property: test.timeout -> 900000 Setting project property: test.junit.output.format -> plain Setting project property: libhdfs.test.conf.dir -> /nfs/jade/vint/HADOOP/hadoop.new/src/c++/libhdfs/tests/conf Setting project property: libhdfs.test.dir -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/libhdfs Setting project property: web.src.dir -> /nfs/jade/vint/HADOOP/hadoop.new/src/web Setting project property: src.webapps -> /nfs/jade/vint/HADOOP/hadoop.new/src/webapps Setting project property: javadoc.link.java -> http://java.sun.com/j2se/1.5/docs/api/ Setting project property: javadoc.packages -> org.apache.hadoop.* Setting project property: dist.dir -> /nfs/jade/vint/HADOOP/hadoop.new/build/hadoop-0.15.0-dev Setting project property: javac.debug -> on Setting project property: javac.optimize -> on Setting project property: javac.deprecation -> off Setting project property: javac.version -> 1.5 Setting project property: javac.args -> Setting project property: javac.args.warnings -> -Xlint:unchecked Setting project property: clover.db.dir -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/clover/db Setting project property: clover.report.dir -> /nfs/jade/vint/HADOOP/hadoop.new/build/test/clover/reports [available] class "com.cenqua.clover.tasks.CloverReportTask" was not found [available] Unable to load class com.cenqua.clover.tasks.CloverReportTask to set property clover.present Condition false; not setting clover.enabled Could not load class (org.apache.tools.ant.taskdefs.optional.image.Image) for type image Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.WLRun) for type wlrun Could not load class (org.apache.tools.ant.taskdefs.optional.IContract) for type icontract Could not load class (org.apache.tools.ant.taskdefs.optional.ide.VAJLoadProjects) for type vajload Could not load class (org.apache.tools.ant.taskdefs.optional.net.RExecTask) for type rexec Adding reference: classpath Could not load class (org.apache.tools.ant.taskdefs.optional.image.Image) for type image Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.WLRun) for type wlrun Could not load class (org.apache.tools.ant.taskdefs.optional.IContract) for type icontract Could not load class (org.apache.tools.ant.taskdefs.optional.ide.VAJLoadProjects) for type vajload Could not load class (org.apache.tools.ant.taskdefs.optional.net.RExecTask) for type rexec Adding reference: test.classpath Could not load class (org.apache.tools.ant.taskdefs.optional.image.Image) for type image Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.WLRun) for type wlrun Could not load class (org.apache.tools.ant.taskdefs.optional.IContract) for type icontract Could not load class (org.apache.tools.ant.taskdefs.optional.ide.VAJLoadProjects) for type vajload Could not load class (org.apache.tools.ant.taskdefs.optional.net.RExecTask) for type rexec Adding reference: test.cluster.classpath Could not load class (org.apache.tools.ant.taskdefs.optional.image.Image) for type image Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.WLRun) for type wlrun Could not load class (org.apache.tools.ant.taskdefs.optional.IContract) for type icontract Could not load class (org.apache.tools.ant.taskdefs.optional.ide.VAJLoadProjects) for type vajload Could not load class (org.apache.tools.ant.taskdefs.optional.net.RExecTask) for type rexec Could not load class (org.apache.tools.ant.taskdefs.optional.starteam.StarTeamList) for type stlist Could not load class (org.apache.tools.ant.taskdefs.optional.net.TelnetTask) for type telnet Could not load class (org.apache.tools.ant.taskdefs.optional.NetRexxC) for type netrexxc Could not load class (org.apache.tools.ant.taskdefs.optional.net.FTP) for type ftp Could not load class (org.apache.tools.ant.taskdefs.optional.scm.AntStarTeamCheckOut) for type starteam Could not load class (org.apache.tools.ant.taskdefs.optional.StyleBook) for type stylebook Could not load class (org.apache.tools.ant.taskdefs.optional.starteam.StarTeamLabel) for type stlabel Could not load class (org.apache.tools.ant.taskdefs.optional.splash.SplashTask) for type splash Could not load class (org.apache.tools.ant.taskdefs.optional.starteam.StarTeamCheckin) for type stcheckin Could not load class (org.apache.tools.ant.taskdefs.optional.ide.VAJExport) for type vajexport Could not load class (org.apache.tools.ant.taskdefs.optional.starteam.StarTeamCheckout) for type stcheckout Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.Ejbc) for type ejbc Could not load class (org.apache.tools.ant.taskdefs.optional.ide.VAJImport) for type vajimport Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.WLStop) for type wlstop Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.DDCreator) for type ddcreator fileset: Setup scanner in dir /nfs/jade/vint/HADOOP/hadoop.new/lib with patternSet{ includes: [**/*.jar] excludes: [**/excluded/] } Finding class org.apache.jasper.JspC Loaded from /nfs/jade/vint/HADOOP/hadoop.new/lib/jetty-ext/jasper-compiler.jar org/apache/jasper/JspC.class Finding class org.apache.jasper.Options Loaded from /nfs/jade/vint/HADOOP/hadoop.new/lib/jetty-ext/jasper-compiler.jar org/apache/jasper/Options.class Class java.lang.Object loaded from parent loader (parentFirst) Class org.apache.jasper.Options loaded from ant loader (parentFirst) Class org.apache.jasper.JspC loaded from ant loader (parentFirst) Class java.lang.Throwable loaded from parent loader (parentFirst) Class java.lang.ClassNotFoundException loaded from parent loader (parentFirst) Class java.lang.NoClassDefFoundError loaded from parent loader (parentFirst) Class java.io.IOException loaded from parent loader (parentFirst) Class java.lang.RuntimeException loaded from parent loader (parentFirst) Class java.lang.ClassLoader loaded from parent loader (parentFirst) Class java.net.URLClassLoader loaded from parent loader (parentFirst) Class java.net.MalformedURLException loaded from parent loader (parentFirst) Class java.io.OutputStream loaded from parent loader (parentFirst) Class java.io.PrintStream loaded from parent loader (parentFirst) Finding class javax.servlet.ServletContext Loaded from /nfs/jade/vint/HADOOP/hadoop.new/lib/servlet-api.jar javax/servlet/ServletContext.class Class javax.servlet.ServletContext loaded from ant loader (parentFirst) Class java.io.Writer loaded from parent loader (parentFirst) Class java.io.FileWriter loaded from parent loader (parentFirst) Class java.io.Reader loaded from parent loader (parentFirst) Class java.io.FileReader loaded from parent loader (parentFirst) Class java.lang.Exception loaded from parent loader (parentFirst) Finding class org.apache.jasper.JasperException Loaded from /nfs/jade/vint/HADOOP/hadoop.new/lib/jetty-ext/jasper-runtime.jar org/apache/jasper/JasperException.class Finding class javax.servlet.ServletException Loaded from /nfs/jade/vint/HADOOP/hadoop.new/lib/servlet-api.jar javax/servlet/ServletException.class Class javax.servlet.ServletException loaded from ant loader (parentFirst) Class org.apache.jasper.JasperException loaded from ant loader (parentFirst) Class java.lang.NumberFormatException loaded from parent loader (parentFirst) Class java.lang.Class loaded from parent loader (parentFirst) Class org.apache.commons.logging.LogFactory loaded from parent loader (parentFirst) Class java.lang.String loaded from parent loader (parentFirst) Class java.io.File loaded from parent loader (parentFirst) Finding class org.apache.jasper.compiler.TldLocationsCache Loaded from /nfs/jade/vint/HADOOP/hadoop.new/lib/jetty-ext/jasper-compiler.jar org/apache/jasper/compiler/TldLocationsCache.class Class org.apache.jasper.compiler.TldLocationsCache loaded from ant loader (parentFirst) Finding class org.apache.jasper.compiler.JspConfig Loaded from /nfs/jade/vint/HADOOP/hadoop.new/lib/jetty-ext/jasper-compiler.jar org/apache/jasper/compiler/JspConfig.class Class org.apache.jasper.compiler.JspConfig loaded from ant loader (parentFirst) Finding class org.apache.jasper.compiler.TagPluginManager Loaded from /nfs/jade/vint/HADOOP/hadoop.new/lib/jetty-ext/jasper-compiler.jar org/apache/jasper/compiler/TagPluginManager.class Class org.apache.jasper.compiler.TagPluginManager loaded from ant loader (parentFirst) Finding class org.apache.jasper.JspCompilationContext Loaded from /nfs/jade/vint/HADOOP/hadoop.new/lib/jetty-ext/jasper-compiler.jar org/apache/jasper/JspCompilationContext.class Class org.apache.jasper.JspCompilationContext loaded from ant loader (parentFirst) +Datatype jsp-compile org.apache.jasper.JspC Setting project property: findbugs.home -> Attempting to create object of type org.apache.tools.ant.helper.DefaultExecutor Adding reference: ant.executor Build sequence for target(s) `compile' is [clover.setup, clover.info, clover, init, record-parser, compile-rcc-compiler, compile-core-classes, compile-core-native, check-c++-makefiles, create-c++-pipes-makefile, create-c++-utils-makefile, compile-c++-utils, compile-c++-pipes, compile-c++, compile-core, compile-contrib, compile-ant-tasks, compile] Complete build sequence is [clover.setup, clover.info, clover, init, record-parser, compile-rcc-compiler, compile-core-classes, compile-core-native, check-c++-makefiles, create-c++-pipes-makefile, create-c++-utils-makefile, compile-c++-utils, compile-c++-pipes, compile-c++, compile-core, compile-contrib, compile-ant-tasks, compile, create-c++-examples-pipes-makefile, compile-c++-examples-pipes, compile-c++-examples, compile-examples, generate-test-records, compile-core-test, test-core, test-contrib, test, jar, default-doc, javadoc, examples, deploy-contrib, ant-tasks, package, tar, nightly, test-cluster, check-for-checkstyle, checkstyle, clover.check, generate-clover-reports, check-for-findbugs, compile-libhdfs, clean-libhdfs, findbugs, metrics.jar, test-libhdfs, doc-libhdfs, create-c++-configure, clean-contrib, clean, package-libhdfs, ] clover.setup: Skipped because property 'clover.enabled' not set. clover.info: [echo] [echo] Clover not found. Code coverage reports disabled. [echo] clover: init: [touch] Setting millis to 33688800000 from datetime attribute Could not load class (org.apache.tools.ant.taskdefs.optional.image.Image) for type image Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.WLRun) for type wlrun Could not load class (org.apache.tools.ant.taskdefs.optional.IContract) for type icontract Could not load class (org.apache.tools.ant.taskdefs.optional.ide.VAJLoadProjects) for type vajload Could not load class (org.apache.tools.ant.taskdefs.optional.net.RExecTask) for type rexec Could not load class (org.apache.tools.ant.taskdefs.optional.starteam.StarTeamList) for type stlist Could not load class (org.apache.tools.ant.taskdefs.optional.net.TelnetTask) for type telnet Could not load class (org.apache.tools.ant.taskdefs.optional.NetRexxC) for type netrexxc Could not load class (org.apache.tools.ant.taskdefs.optional.net.FTP) for type ftp Could not load class (org.apache.tools.ant.taskdefs.optional.scm.AntStarTeamCheckOut) for type starteam Could not load class (org.apache.tools.ant.taskdefs.optional.StyleBook) for type stylebook Could not load class (org.apache.tools.ant.taskdefs.optional.starteam.StarTeamLabel) for type stlabel Could not load class (org.apache.tools.ant.taskdefs.optional.splash.SplashTask) for type splash Could not load class (org.apache.tools.ant.taskdefs.optional.starteam.StarTeamCheckin) for type stcheckin Could not load class (org.apache.tools.ant.taskdefs.optional.ide.VAJExport) for type vajexport Could not load class (org.apache.tools.ant.taskdefs.optional.starteam.StarTeamCheckout) for type stcheckout Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.Ejbc) for type ejbc Could not load class (org.apache.tools.ant.taskdefs.optional.ide.VAJImport) for type vajimport Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.WLStop) for type wlstop Could not load class (org.apache.tools.ant.taskdefs.optional.ejb.DDCreator) for type ddcreator fileset: Setup scanner in dir /nfs/jade/vint/HADOOP/hadoop.new/conf with patternSet{ includes: [**/*.template] excludes: [] } > Hadoop build (ant) hangs while setting up init target, build process hangs > -------------------------------------------------------------------------- > > Key: HADOOP-1773 > URL: https://issues.apache.org/jira/browse/HADOOP-1773 > Project: Hadoop > Issue Type: Bug > Components: build > Affects Versions: 0.15.0 > Environment: Fedora7 on x64, java version "1.6.0_02", latest hadoop (svn version as of 8/21/07), ant version 1.7.0 (but same problem with 1.6.5) > Reporter: Yuri Pradkin > Priority: Critical > > Ant hangs during a build process, eventually (in hours) dies of heap exhaustion. > The problematic lines in build.xml seem to be in the init target (fileset operations): > - > - > - > - > - > - > - > - > - > - > - > - > Commenting them out or deleting allows build to proceed to sucessful completion. Not being an expert, > in either xml or ant, I'm not sure what exactly I'm missing with those lines gone, but at least I'm able to compile. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.