Return-Path: Delivered-To: apmail-incubator-cassandra-commits-archive@minotaur.apache.org Received: (qmail 36111 invoked from network); 10 Jul 2009 15:39:30 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 10 Jul 2009 15:39:30 -0000 Received: (qmail 85749 invoked by uid 500); 10 Jul 2009 15:39:40 -0000 Delivered-To: apmail-incubator-cassandra-commits-archive@incubator.apache.org Received: (qmail 85732 invoked by uid 500); 10 Jul 2009 15:39:39 -0000 Mailing-List: contact cassandra-commits-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cassandra-dev@incubator.apache.org Delivered-To: mailing list cassandra-commits@incubator.apache.org Received: (qmail 85722 invoked by uid 99); 10 Jul 2009 15:39:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Jul 2009 15:39:39 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Jul 2009 15:39:36 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id C6675234C004 for ; Fri, 10 Jul 2009 08:39:14 -0700 (PDT) Message-ID: <353729271.1247240354808.JavaMail.jira@brutus> Date: Fri, 10 Jul 2009 08:39:14 -0700 (PDT) From: "Jonathan Ellis (JIRA)" To: cassandra-commits@incubator.apache.org Subject: [jira] Commented: (CASSANDRA-283) Cassandra leaks FDs In-Reply-To: <1248595642.1247088914795.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CASSANDRA-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12729680#action_12729680 ] Jonathan Ellis commented on CASSANDRA-283: ------------------------------------------ Let's re-test after committing CASSANDRA-287 so there's only one code path to debug. :) > Cassandra leaks FDs > ------------------- > > Key: CASSANDRA-283 > URL: https://issues.apache.org/jira/browse/CASSANDRA-283 > Project: Cassandra > Issue Type: Bug > Environment: Debian Etch, J2SE 1.6.0 > Reporter: Ian Eure > > Cassandra leaks file descriptors like crazy. I started getting these errors after a few hours of uptime: > java.lang.RuntimeException: java.io.FileNotFoundException: /var/cassandra/data/Digg-Items-2-Data.db (Too many open files) > at org.apache.cassandra.service.CassandraServer.readColumnFamily(CassandraServer.java:84) > at org.apache.cassandra.service.CassandraServer.get_slice(CassandraServer.java:181) > at org.apache.cassandra.service.Cassandra$Processor$get_slice.process(Cassandra.java:859) > at org.apache.cassandra.service.Cassandra$Processor.process(Cassandra.java:817) > at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:252) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:619) > Caused by: java.io.FileNotFoundException: /var/cassandra/data/Digg-Items-2-Data.db (Too many open files) > at java.io.RandomAccessFile.open(Native Method) > at java.io.RandomAccessFile.(RandomAccessFile.java:212) > at java.io.RandomAccessFile.(RandomAccessFile.java:98) > at org.apache.cassandra.io.BufferedRandomAccessFile.(BufferedRandomAccessFile.java:141) > at org.apache.cassandra.io.SequenceFile$BufferReader.init(SequenceFile.java:811) > at org.apache.cassandra.io.SequenceFile$Reader.(SequenceFile.java:743) > at org.apache.cassandra.io.SequenceFile$BufferReader.(SequenceFile.java:805) > at org.apache.cassandra.io.SequenceFile$ColumnGroupReader.(SequenceFile.java:248) > at org.apache.cassandra.io.SSTableReader.getColumnGroupReader(SSTableReader.java:346) > at org.apache.cassandra.db.SSTableColumnIterator.(ColumnIterator.java:61) > at org.apache.cassandra.db.ColumnFamilyStore.getSliceFrom(ColumnFamilyStore.java:1589) > at org.apache.cassandra.db.Table.getRow(Table.java:596) > at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:60) > at org.apache.cassandra.service.StorageProxy.weakReadLocal(StorageProxy.java:600) > at org.apache.cassandra.service.StorageProxy.readProtocol(StorageProxy.java:303) > at org.apache.cassandra.service.CassandraServer.readColumnFamily(CassandraServer.java:80) > I have an open file limit of 1024. Examining the lsof output for Cassandra shows 975 FDs for the same file: /var/cassandra/data/Digg-Items-2-Data.db > Clearly, these FDs are leaking somewhere. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.