Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 86617 invoked from network); 22 Jun 2009 09:48:01 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 22 Jun 2009 09:48:01 -0000 Received: (qmail 16465 invoked by uid 500); 22 Jun 2009 09:48:10 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 16382 invoked by uid 500); 22 Jun 2009 09:48:10 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 16372 invoked by uid 99); 22 Jun 2009 09:48:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Jun 2009 09:48:10 +0000 X-ASF-Spam-Status: No, hits=-2.8 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [192.6.10.2] (HELO colossus.hpl.hp.com) (192.6.10.2) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Jun 2009 09:47:58 +0000 Received: from localhost (localhost [127.0.0.1]) by colossus.hpl.hp.com (Postfix) with ESMTP id 897E61BA35E for ; Mon, 22 Jun 2009 10:47:37 +0100 (BST) X-Virus-Scanned: Debian amavisd-new at hpl.hp.com Received: from colossus.hpl.hp.com ([127.0.0.1]) by localhost (colossus.hpl.hp.com [127.0.0.1]) (amavisd-new, port 10024) with LMTP id RivJIwo+JBVO for ; Mon, 22 Jun 2009 10:47:37 +0100 (BST) Received: from 0-imap-br1.hpl.hp.com (0-imap-br1.hpl.hp.com [16.25.144.60]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by colossus.hpl.hp.com (Postfix) with ESMTPS id 047A51BA35D for ; Mon, 22 Jun 2009 10:47:36 +0100 (BST) MailScanner-NULL-Check: 1246268843.84906@BZ4nVRwAHzXGCK5RaW6qMQ Received: from [16.25.171.118] (morzine.hpl.hp.com [16.25.171.118]) by 0-imap-br1.hpl.hp.com (8.14.1/8.13.4) with ESMTP id n5M9lMhE024618 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Mon, 22 Jun 2009 10:47:23 +0100 (BST) Message-ID: <4A3F532A.9060601@apache.org> Date: Mon, 22 Jun 2009 10:47:22 +0100 From: Steve Loughran User-Agent: Thunderbird 2.0.0.21 (X11/20090302) MIME-Version: 1.0 To: core-user@hadoop.apache.org Subject: Re: "Too many open files" error, which gets resolved after some time References: <77938bc20906210306q152c8681g2af43dd34b3f6ed0@mail.gmail.com> <77938bc20906210527o57e57972v1d3c3ee0fd306771@mail.gmail.com> <4A3F3B3D.3040709@yahoo-inc.com> In-Reply-To: <4A3F3B3D.3040709@yahoo-inc.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-HPL-MailScanner-Information: Please contact the ISP for more information X-MailScanner-ID: n5M9lMhE024618 X-HPL-MailScanner: Found to be clean X-HPL-MailScanner-From: stevel@apache.org X-Virus-Checked: Checked by ClamAV on apache.org Raghu Angadi wrote: > > Is this before 0.20.0? Assuming you have closed these streams, it is > mostly https://issues.apache.org/jira/browse/HADOOP-4346 > > It is the JDK internal implementation that depends on GC to free up its > cache of selectors. HADOOP-4346 avoids this by using hadoop's own cache. yes, and it's that change that led to my stack traces :( http://jira.smartfrog.org/jira/browse/SFOS-1208