Return-Path: 
 <hadoop-dev-return-7434-apmail-lucene-hadoop-dev-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org
Received: (qmail 26635 invoked from network); 1 Feb 2007 17:18:27 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2)
  by minotaur.apache.org with SMTP; 1 Feb 2007 17:18:27 -0000
Received: (qmail 94408 invoked by uid 500); 1 Feb 2007 17:18:31 -0000
Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org
Received: (qmail 94384 invoked by uid 500); 1 Feb 2007 17:18:30 -0000
Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:hadoop-dev-help@lucene.apache.org>
List-Unsubscribe: <mailto:hadoop-dev-unsubscribe@lucene.apache.org>
List-Post: <mailto:hadoop-dev@lucene.apache.org>
List-Id: <hadoop-dev.lucene.apache.org>
Reply-To: hadoop-dev@lucene.apache.org
Delivered-To: mailing list hadoop-dev@lucene.apache.org
Received: (qmail 94364 invoked by uid 99); 1 Feb 2007 17:18:30 -0000
Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Feb 2007 09:18:30 -0800
X-ASF-Spam-Status: No, hits=0.0 required=10.0
	tests=
X-Spam-Check-By: apache.org
Received-SPF: pass (herse.apache.org: local policy)
Received: from [84.96.21.10] (HELO trinity.anyware-tech.com) (84.96.21.10)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Feb 2007 09:18:22 -0800
Received: from localhost (localhost [127.0.0.1])
	by trinity.anyware-tech.com (Postfix) with ESMTP id 70542487B77
	for <hadoop-dev@lucene.apache.org>; Thu,  1 Feb 2007 18:18:00 +0100 (CET)
Received: from trinity.anyware-tech.com ([127.0.0.1])
	by localhost (trinity.anyware-tech.com [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id 23254-04 for <hadoop-dev@lucene.apache.org>;
	Thu, 1 Feb 2007 18:17:54 +0100 (CET)
Received: from [10.0.3.15] (bauer.anyware [10.0.3.15])
	by trinity.anyware-tech.com (Postfix) with ESMTP id 340E0487B6F
	for <hadoop-dev@lucene.apache.org>; Thu,  1 Feb 2007 18:17:54 +0100 (CET)
Message-ID: <45C220C4.1030208@anyware-tech.com>
Date: Thu, 01 Feb 2007 18:17:56 +0100
From: Thomas Friol <thomas@anyware-tech.com>
Organization: Anyware Technologies
User-Agent: Thunderbird 1.5.0.9 (X11/20070103)
MIME-Version: 1.0
To: hadoop-dev@lucene.apache.org
Subject: Re: OutOfMemoryError in the job tracker
References: <45C19FEE.50402@anyware-tech.com> <45C21D54.90400@yahoo-inc.com>
In-Reply-To: <45C21D54.90400@yahoo-inc.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-Virus-Scanned: Debian amavisd-new at anyware-tech.com
X-Virus-Checked: Checked by ClamAV on apache.org

Hi Koji,

Thanks for your help. Will investigate the options you give.

Thomas.

Koji Noguchi a �crit :
> Hi Thomas,
>
> I think we had the same problem before.  Dhruba pointed out,
>
> http://bugs.sun.com/bugdatabase/view_bug.do;:YfiG?bug_id=4705373
>
> > Did someone have a solution to avoid this ?
> >
> Couple of options.
> 1) Ask the users to submit smaller jar file.
> 2) Use JDK 1.6
> 3) Use 64-bit JVM
>
> Hope it works.
>
> Koji
>
>
> Thomas Friol wrote:
>> Hi,
>>
>> I am using the 0.10.1 version of hadoop and after less than 24 hour of
>> running, the jobtracker send the following error when it tries to run a
>> job :
>>
>> 2007-02-01 04:10:09,285 ERROR org.apache.hadoop.mapred.JobTracker: Job
>> initialization failed:
>> java.lang.OutOfMemoryError
>>     at java.util.zip.ZipFile.open(Native Method)
>>     at java.util.zip.ZipFile.<init>(ZipFile.java:203)
>>     at java.util.jar.JarFile.<init>(JarFile.java:132)
>>     at java.util.jar.JarFile.<init>(JarFile.java:70)
>>     at sun.misc.URLClassPath$JarLoader.getJarFile(URLClassPath.java:579)
>>     at sun.misc.URLClassPath$JarLoader.<init>(URLClassPath.java:546)
>>     at sun.misc.URLClassPath$3.run(URLClassPath.java:324)
>>     at java.security.AccessController.doPrivileged(Native Method)
>>     at sun.misc.URLClassPath.getLoader(URLClassPath.java:313)
>>     at sun.misc.URLClassPath.getLoader(URLClassPath.java:290)
>>     at sun.misc.URLClassPath.getResource(URLClassPath.java:160)
>>     at java.net.URLClassLoader$1.run(URLClassLoader.java:192)
>>     at java.security.AccessController.doPrivileged(Native Method)
>>     at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>     at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
>>     at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
>>     at java.lang.Class.forName0(Native Method)
>>     at java.lang.Class.forName(Class.java:242)
>>     at
>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:315)
>>
>>     at
>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:326)
>>     at
>> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:339)
>>     at org.apache.hadoop.mapred.JobConf.getInputFormat(JobConf.java:263)
>>     at
>> org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:123)
>>     at
>> org.apache.hadoop.mapred.JobTracker$JobInitThread.run(JobTracker.java:360)
>>
>>     at java.lang.Thread.run(Thread.java:595)
>>
>> Did soemone notice the same kind of behavior ?
>> Did someone have a solution to avoid this ?
>>
>> I just found that restarting the jobtracker solves the problem but
>> that's it.
>>
>> Thanks for any help.
>>
>

-- 
Thomas FRIOL
Joost
ANYWARE TECHNOLOGIES
T�l      : +33 (0)561 000 653
Portable : +33 (0)609 704 810
Fax      : +33 (0)561 005 146
www.anyware-tech.com