Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 894B7B1BF for ; Sun, 8 Jan 2012 23:49:04 +0000 (UTC) Received: (qmail 8911 invoked by uid 500); 8 Jan 2012 23:49:04 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 8712 invoked by uid 500); 8 Jan 2012 23:49:03 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 8678 invoked by uid 99); 8 Jan 2012 23:49:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 08 Jan 2012 23:49:03 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 08 Jan 2012 23:49:00 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 5639613EE2D for ; Sun, 8 Jan 2012 23:48:39 +0000 (UTC) Date: Sun, 8 Jan 2012 23:48:39 +0000 (UTC) From: "Caleb William Rackliffe (Updated) (JIRA)" To: commits@cassandra.apache.org Message-ID: <1185274339.20413.1326066519354.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <483436420.20412.1326066519299.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (CASSANDRA-3711) Unsustainable Thread Accumulation in ParallelCompactionIterable.Reducer ThreadPoolExecutor MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CASSANDRA-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Caleb William Rackliffe updated CASSANDRA-3711: ----------------------------------------------- Environment: - Linux version 2.6.32-71.29.1.el6.x86_64 (mockbuild@c6b5.bsys.dev.centos.org) (gcc version 4.4.4 20100726 (Red Hat 4.4.4-13) (GCC) ) #1 SMP Mon Jun 27 19:49:27 BST 2011 - java version "1.7.0_01" / Java(TM) SE Runtime Environment (build 1.7.0_01-b08) / Java HotSpot(TM) 64-Bit Server VM (build 21.1-b02, mixed mode) was:Linux version 2.6.32-71.29.1.el6.x86_64 (mockbuild@c6b5.bsys.dev.centos.org) (gcc version 4.4.4 20100726 (Red Hat 4.4.4-13) (GCC) ) #1 SMP Mon Jun 27 19:49:27 BST 2011 > Unsustainable Thread Accumulation in ParallelCompactionIterable.Reducer ThreadPoolExecutor > ------------------------------------------------------------------------------------------ > > Key: CASSANDRA-3711 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3711 > Project: Cassandra > Issue Type: Bug > Components: Core > Affects Versions: 1.0.5 > Environment: - Linux version 2.6.32-71.29.1.el6.x86_64 (mockbuild@c6b5.bsys.dev.centos.org) (gcc version 4.4.4 20100726 (Red Hat 4.4.4-13) (GCC) ) #1 SMP Mon Jun 27 19:49:27 BST 2011 > - java version "1.7.0_01" / Java(TM) SE Runtime Environment (build 1.7.0_01-b08) / Java HotSpot(TM) 64-Bit Server VM (build 21.1-b02, mixed mode) > Reporter: Caleb William Rackliffe > Labels: memory_leak, threading, threads > > With multithreaded compaction enabled, it looks like Reducer creates a new thread pool for every compaction. These pools seem to just sit around - i.e. "executor.shutdown()" never gets called and the Threads live forever waiting for tasks that will never come. For instance... > Name: CompactionReducer:1 > State: TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@72938aea > Total blocked: 0 Total waited: 1 > Stack trace: > sun.misc.Unsafe.park(Native Method) > java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) > java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > java.lang.Thread.run(Thread.java:722) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira