Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 27367 invoked from network); 26 Feb 2009 09:50:59 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 26 Feb 2009 09:50:59 -0000 Received: (qmail 50380 invoked by uid 500); 26 Feb 2009 09:50:52 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 50315 invoked by uid 500); 26 Feb 2009 09:50:52 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 50304 invoked by uid 99); 26 Feb 2009 09:50:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Feb 2009 01:50:52 -0800 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [216.145.54.171] (HELO mrout1.yahoo.com) (216.145.54.171) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Feb 2009 09:50:42 +0000 Received: from [192.168.1.64] (snvvpn2-10-72-76-c42.hq.corp.yahoo.com [10.72.76.42]) by mrout1.yahoo.com (8.13.6/8.13.6/y.out) with ESMTP id n1Q9oAuS051705 for ; Thu, 26 Feb 2009 01:50:11 -0800 (PST) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=message-id:from:to:in-reply-to:content-type: content-transfer-encoding:mime-version:subject:date:references:x-mailer; b=zoFcvnYdtvA7e1qHVsVeoeMg7qn4SCx3LTyF7vQh07kN007FacZztJtqDgbA6l1j Message-Id: <1C3822D4-2C58-4A48-B789-208BA48728AE@yahoo-inc.com> From: Arun C Murthy To: core-user@hadoop.apache.org In-Reply-To: <22193552.post@talk.nabble.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v930.3) Subject: Re: OutOfMemory error processing large amounts of gz files Date: Thu, 26 Feb 2009 01:50:10 -0800 References: <22193552.post@talk.nabble.com> X-Mailer: Apple Mail (2.930.3) X-Virus-Checked: Checked by ClamAV on apache.org On Feb 24, 2009, at 4:03 PM, bzheng wrote: > > 2009-02-23 14:27:50,902 INFO org.apache.hadoop.mapred.TaskTracker: > java.lang.OutOfMemoryError: Java heap space > That tells that that your TaskTracker is running out of memory, not your reduce tasks. I think you are hitting http://issues.apache.org/jira/browse/ HADOOP-4906. What version of hadoop are you running? Arun