Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of hadoopman@gmail.com
 designates 209.85.214.176 as permitted sender)
Message-ID: <4F59A861.9090203@gmail.com>
Date: Thu, 08 Mar 2012 23:51:13 -0700
From: hadoopman <hadoopman@gmail.com>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US;
 rv:1.9.2.24) Gecko/20111108 Thunderbird/3.1.16
MIME-Version: 1.0
To: common-user@hadoop.apache.org
Subject: Re: Java Heap space error
References: 
 <CAOT3TWoL5jT0C0BaJJn9RMig0j4V863J=hF5d+dT0dd4xksznQ@mail.gmail.com>
	<CAOT3TWrq4tukDAQE5O8pW69LGho3xcPpcK5YyfZz_VN9gFuJxQ@mail.gmail.com>
	<CAOT3TWpBEcu-hCgx-_rhpYY9b8FBsbA=zcZpwUZmAE+6L_Uwww@mail.gmail.com>
 <CAOT3TWoadc+r5Mwi1iTJ0o_+JcO_YomApjdZ4qE2baEdW5N_6A@mail.gmail.com>
In-Reply-To: 
 <CAOT3TWoadc+r5Mwi1iTJ0o_+JcO_YomApjdZ4qE2baEdW5N_6A@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

I'm curious if you have been able to track down the cause of the error?  
We've seen similar problems with loading data and I've discovered if I 
presort my data before the load that things go a LOT smoother.

When running queries against our data sometimes we've seen it where the 
jobtracker just freezes.  I've seen Heap out of memory errors when I 
cranked up jobtracker logging to debug.  Still working on figuring this 
one out.  should be an interesting ride :D


On 03/06/2012 11:10 AM, Mohit Anchlia wrote:
> I am still trying to see how to narrow this down. Is it possible to set
> heapdumponoutofmemoryerror option on these individual tasks?
>
> On Mon, Mar 5, 2012 at 5:49 PM, Mohit Anchlia<mohitanchlia@gmail.com>wrote:
>
>>