Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 80981 invoked from network); 18 Apr 2010 13:20:29 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 18 Apr 2010 13:20:29 -0000 Received: (qmail 15234 invoked by uid 500); 18 Apr 2010 13:20:28 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 15208 invoked by uid 500); 18 Apr 2010 13:20:28 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 15200 invoked by uid 99); 18 Apr 2010 13:20:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 18 Apr 2010 13:20:28 +0000 X-ASF-Spam-Status: No, hits=-0.3 required=10.0 tests=AWL,FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jbellis@gmail.com designates 74.125.82.44 as permitted sender) Received: from [74.125.82.44] (HELO mail-ww0-f44.google.com) (74.125.82.44) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 18 Apr 2010 13:20:24 +0000 Received: by wwi18 with SMTP id 18so92740wwi.31 for ; Sun, 18 Apr 2010 06:20:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :from:date:received:message-id:subject:to:content-type :content-transfer-encoding; bh=6Y7kMAJ6uIzxQMK1ORtZwTWY8qxGvsr6Nce522sAr1k=; b=fRygWkkTb90/JXnYCsR6VR0hzkdbp7bd4ryP4AhBlaKe2YFTSw0tMxUDTysUaQg+Sz 6qEPDp2dkeTY2jKSb9U5mbgX1iVJYUB/OMXHluwC2HwkgT+K5jAZS9SCqO+qxFhFr2xi JeAzUU/fE705QPHJqF0teiwZnazQ6c4Whs7ZY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; b=n+QRS/uOSRQ00cUn74M05ohm9HZOflzLWb6ijJPp2BD7TRhqHNRidPWFUx2nJEvKNU NRXppGVqtiGohZMb7AfLoTzfy54zk56F8UPeiDqhcjeUucbXn5f0igK3C9xRciFLNGRo r1f9n4/HTsO9rOqsZ5nxtQk3QbW5ZdxcABCuo= MIME-Version: 1.0 Received: by 10.216.17.147 with HTTP; Sun, 18 Apr 2010 06:19:42 -0700 (PDT) In-Reply-To: References: <1271170492.32464.73.camel@erebus.lan> <1271192079.32464.111.camel@erebus.lan> <87bpdm5ajr.fsf@lifelogs.com> <1271265799.32464.140.camel@erebus.lan> <878w8p52k6.fsf@lifelogs.com> <4E81871D-AB06-45CA-8E30-535F217E609E@digg.com> From: Jonathan Ellis Date: Sun, 18 Apr 2010 08:19:42 -0500 Received: by 10.216.186.138 with SMTP id w10mr5190230wem.206.1271596802421; Sun, 18 Apr 2010 06:20:02 -0700 (PDT) Message-ID: Subject: Re: [RELEASE] 0.6.0 To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable sounds like http://wiki.apache.org/cassandra/FAQ#slows_down_after_lotso_ins= erts On Sun, Apr 18, 2010 at 3:05 AM, Schubert Zhang wrote: > Thanks Jonathan and Chris, > > I am using 6u19 in above test: > > [cassandra@nd1-rack0-cloud cassandra]$ java -version > java version "1.6.0_19" > Java(TM) SE Runtime Environment (build 1.6.0_19-b04) > Java HotSpot(TM) 64-Bit Server VM (build 16.2-b04, mixed mode) > > > On Sun, Apr 18, 2010 at 12:56 PM, Jonathan Ellis wrot= e: >> >> Ugh, I mean the fix for LBQ, and it was actually in u19 not 20. >> >> http://java.sun.com/javase/6/webnotes/6u19.html >> >> On Sat, Apr 17, 2010 at 11:38 PM, Jonathan Ellis >> wrote: >> > jdk 1.6 b20 has the fix for the CLQ gc problem, btw. >> > >> > On Sat, Apr 17, 2010 at 11:31 PM, Chris Goffinet >> > wrote: >> >> I wonder if that might be related to this: >> >> https://issues.apache.org/jira/browse/CASSANDRA-896 >> >> We switched from a Concurrent structure to LinkedBlockingQueue in 0.6= . >> >> -Chris >> >> On Apr 17, 2010, at 9:26 PM, Schubert Zhang wrote: >> >> >> >> We are testing 0.6.0, compares with 0.5.1,=A0 and it seems: >> >> >> >> 1. 0.6.0 need more memory/heap. >> >> 2. after inserted billions of columns, tens-million of keys, the >> >> inseting >> >> operation become very slow and jamed. >> >> Exceptions TimeoutException and UnavailableException are throwed >> >> sometimes. >> >> >> >> I add more log, such as : >> >> >> >> =A0WARN [pool-1-thread-4] 2010-04-18 00:00:00,534 CassandraServer.jav= a >> >> (line >> >> 460) UnavailableException() >> >> UnavailableException() >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.service.StorageProxy.assureSufficientLiveNodes(S= torageProxy.java:298) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.service.StorageProxy.mutateBlocking(StorageProxy= .java:208) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.= java:452) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.thrift.CassandraServer.insert(CassandraServer.ja= va:362) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.thrift.Cassandra$Processor$insert.process(Cassan= dra.java:1484) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.jav= a:1125) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadP= oolServer.java:253) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec= utor.java:886) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:908) >> >> =A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.java:619) >> >> >> >> =A0WARN [pool-1-thread-5] 2010-04-18 12:20:03,614 CassandraServer.jav= a >> >> (line >> >> 456) java.util.concurrent.TimeoutException: Operation tim >> >> ed out - received only 00 responses >> >> java.util.concurrent.TimeoutException: Operation timed out - received >> >> only >> >> 00 responses >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.service.WriteResponseHandler.get(WriteResponseHa= ndler.java:77) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.service.StorageProxy.mutateBlocking(StorageProxy= .java:262) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.= java:452) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.thrift.CassandraServer.insert(CassandraServer.ja= va:362) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.thrift.Cassandra$Processor$insert.process(Cassan= dra.java:1484) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.jav= a:1125) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadP= oolServer.java:253) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExec= utor.java:886) >> >> =A0=A0=A0=A0=A0=A0=A0 at >> >> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:908) >> >> =A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.java:619) >> >> >> >> and >> >> =A0INFO [Timer-1] 2010-04-18 11:09:13,928 Gossiper.java (line 179) >> >> InetAddress >> >> /10.24.1.16 is now dead. >> >> =A0INFO [Timer-1] 2010-04-18 11:09:14,930 Gossiper.java (line 179) >> >> InetAddress >> >> /10.24.1.14 is now dead. >> >> =A0INFO [Timer-1] 2010-04-18 11:09:14,930 Gossiper.java (line 179) >> >> InetAddress >> >> /10.24.1.18 is now dead. >> >> >> >> In fact, these node are alive. >> >> >> >> >> >> >> >> >> >> 2010/4/15 Ted Zlatanov >> >>> >> >>> On Wed, 14 Apr 2010 12:23:19 -0500 Eric Evans >> >>> wrote: >> >>> >> >>> EE> On Wed, 2010-04-14 at 10:16 -0500, Ted Zlatanov wrote: >> >>> >> Can it support a non-root user through /etc/default/cassandra? >> >>> >> =A0I've >> >>> >> been patching the init script myself but was hoping this would be >> >>> >> standard. >> >>> >> >>> EE> It's the first item on debian/TODO, but, you know, patches welco= me >> >>> and >> >>> EE> all that. >> >>> >> >>> The appended patch has been sufficient for me. =A0I have to override= the >> >>> PIDFILE too, but that's a system issue. =A0So my /etc/default/cassan= dra, >> >>> for example, is: >> >>> >> >>> JAVA_HOME=3D"/usr/lib/jvm/java-6-sun" >> >>> USER=3Dcassandra >> >>> PIDFILE=3D/var/tmp/$NAME.pid >> >>> >> >>> Ted >> >>> >> >>> --- debian/init 2010-04-14 12:57:30.000000000 -0500 >> >>> +++ /etc/init.d/cassandra =A0 =A0 =A0 2010-04-14 13:00:25.000000000 = -0500 >> >>> @@ -21,6 +21,7 @@ >> >>> =A0JSVC=3D/usr/bin/jsvc >> >>> =A0JVM_MAX_MEM=3D"1G" >> >>> =A0JVM_START_MEM=3D"128M" >> >>> +USER=3Droot >> >>> >> >>> =A0[ -e /usr/share/cassandra/apache-cassandra.jar ] || exit 0 >> >>> =A0[ -e /etc/cassandra/storage-conf.xml ] || exit 0 >> >>> @@ -75,6 +76,7 @@ >> >>> =A0 =A0 is_running && return 1 >> >>> >> >>> =A0 =A0 $JSVC \ >> >>> + =A0 =A0 =A0 =A0-user $USER \ >> >>> =A0 =A0 =A0 =A0 -home $JAVA_HOME \ >> >>> =A0 =A0 =A0 =A0 -pidfile $PIDFILE \ >> >>> =A0 =A0 =A0 =A0 -errfile "&1" \ >> >>> >> >> >> >> >> >> >> > > >