From cassandra-user-return-2623-apmail-incubator-cassandra-user-archive=incubator.apache.org@incubator.apache.org Fri Feb 19 22:55:58 2010 Return-Path: Delivered-To: apmail-incubator-cassandra-user-archive@minotaur.apache.org Received: (qmail 49869 invoked from network); 19 Feb 2010 22:55:58 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 19 Feb 2010 22:55:58 -0000 Received: (qmail 41487 invoked by uid 500); 19 Feb 2010 22:55:58 -0000 Delivered-To: apmail-incubator-cassandra-user-archive@incubator.apache.org Received: (qmail 41430 invoked by uid 500); 19 Feb 2010 22:55:58 -0000 Mailing-List: contact cassandra-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cassandra-user@incubator.apache.org Delivered-To: mailing list cassandra-user@incubator.apache.org Received: (qmail 41421 invoked by uid 99); 19 Feb 2010 22:55:58 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Feb 2010 22:55:58 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of adamfisk@gmail.com designates 209.85.217.224 as permitted sender) Received: from [209.85.217.224] (HELO mail-gx0-f224.google.com) (209.85.217.224) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Feb 2010 22:55:46 +0000 Received: by gxk24 with SMTP id 24so668423gxk.7 for ; Fri, 19 Feb 2010 14:55:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to :content-type:content-transfer-encoding; bh=S+WjhHOKmJcfMNuGwH153fwp7Ce0seVK/YDT4iT+gP4=; b=Iie/CEpfmJTScuhbpMZa31nV13HSpXhkVMPl3q+sV4oeiuGLpexkPytboe4cpVvUOk ZYhPr1CRaVu1WPj/GKq7H5z9oNO2L9VwXL6q/BN7TjxZrvl/ZHF7uTmrbXYbFYExdz3a fzXVtRyRCLPWmYzSIt+oiIDUyPBk3VlqZJgbE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=oBcMbrGzuCuC39grm/dyBjI3B1OQsFWyrxjeUIXQEuWJcNuv0CuxsNFs04AvPSCeMr uMvnfzWQ/kNXobaP56lKBsTm9aHjqBU2NfkIpkjmtwF3jmmfcDxxesnRye5AzsQkcBU8 8zQkgbTEvIa+aa1egV+ZksBzTHNW54CyxWpe8= MIME-Version: 1.0 Sender: adamfisk@gmail.com Received: by 10.231.153.1 with SMTP id i1mr936764ibw.35.1266620122609; Fri, 19 Feb 2010 14:55:22 -0800 (PST) In-Reply-To: References: Date: Fri, 19 Feb 2010 14:55:22 -0800 X-Google-Sender-Auth: 39140529c72f535b Message-ID: Subject: Re: Cassandra error with large connection From: Adam Fisk To: cassandra-user@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org At least on Windows this particular error is quite unique. Oddly, increasing the maximum heap value *makes it worse.* The key is the "native" part of the message -- it's running out of main OS memory that's getting allocated outside of the JVM. The overall issue is allocating too many threads. I'm guessing you're using a cached thread pool. If you decrease the MX value, you'll be able to create more threads, but you'll still almost certainly hit the same issue eventually. -Adam On Tue, Feb 2, 2010 at 3:06 AM, JKnight JKnight wrote= : > Thank you very much, Mr Jonathan. > > On Mon, Feb 1, 2010 at 11:04 AM, Jonathan Ellis wrote= : >> >> On Mon, Feb 1, 2010 at 10:03 AM, Jonathan Ellis wrot= e: >> >> I see a lot of CLOSE_WAIT TCP connection. >> >> Also, this sounds like you are not properly pooling client connections >> to casssandra. =A0You should have one connection per user, not one >> connection per operation. >> >> -Jonathan > > > > -- > Best regards, > JKnight > --=20 Adam Fisk http://www.littleshoot.org | http://adamfisk.wordpress.com | http://twitter.com/adamfisk