Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 98149 invoked from network); 4 Jun 2008 16:34:22 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 4 Jun 2008 16:34:22 -0000 Received: (qmail 64232 invoked by uid 500); 4 Jun 2008 16:34:22 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 63584 invoked by uid 500); 4 Jun 2008 16:34:21 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Delivered-To: moderator for core-user@hadoop.apache.org Received: (qmail 48126 invoked by uid 99); 4 Jun 2008 16:25:19 -0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of cutting@gmail.com designates 209.85.200.171 as permitted sender) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding:sender; bh=+DYSNAZdDm9AQonhsZIrhouz/1IJZ97s+xIR4tMKb9M=; b=MQDsZ1SbG++X1F9WLC3KJBMudojz/z7tosLYgkfrZXT6X5Ly0lwtDh8a3fhgImJ765 AQyqMFQzgjwZ1qJUz9wCHHnF/AxnMg9wXbg+SclTPIUNNZIAioJFw06QjOT/IEDIYkUG Btn96P8wbCoBh/Y1pRELpvaWdx7XCc43lNvUI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding:sender; b=eLkSOeYkbjtniKap94Iqeip5m38q15fSIe214QQYomdeG5yIe+MEmhzcVp4rCBQkyP trPQiD5ZzwYZ/kpg5P7fB4RGp1B7PulqAX8p24kku5RzWYf5zeCJXFHrA7J/ybNyrO9c VONPVGa/2VXidAMD7EQCO2mToVCPn8yqQtF0w= Message-ID: <4846C1D0.3020006@apache.org> Date: Wed, 04 Jun 2008 09:24:48 -0700 From: Doug Cutting User-Agent: Thunderbird 2.0.0.14 (X11/20080505) MIME-Version: 1.0 To: core-user@hadoop.apache.org Subject: Re: Stackoverflow References: <200806021912.35346.andreas@kostyrka.org> In-Reply-To: <200806021912.35346.andreas@kostyrka.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Sender: Doug Cutting X-Virus-Checked: Checked by ClamAV on apache.org Andreas Kostyrka wrote: > java.lang.StackOverflowError > at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.compare(MapTask.java:494) > at org.apache.hadoop.util.QuickSort.fix(QuickSort.java:29) > at org.apache.hadoop.util.QuickSort.sort(QuickSort.java:58) > at org.apache.hadoop.util.QuickSort.sort(QuickSort.java:82) Quicksort is known to cause stack overflows when sorting large, already-sorted data. Could that be the issue here? http://safari.oreilly.com/0201361205/ch07lev1sec3 http://www.finesse.demon.co.uk/steven/sorting.html#quicksort http://www.seeingwithc.org/topic2html.html Doug