Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 86702 invoked from network); 16 Dec 2010 17:46:39 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 16 Dec 2010 17:46:39 -0000 Received: (qmail 50106 invoked by uid 500); 16 Dec 2010 17:46:37 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 50082 invoked by uid 500); 16 Dec 2010 17:46:37 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 50074 invoked by uid 99); 16 Dec 2010 17:46:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Dec 2010 17:46:37 +0000 X-ASF-Spam-Status: No, hits=0.6 required=10.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [74.125.149.67] (HELO na3sys009aog101.obsmtp.com) (74.125.149.67) by apache.org (qpsmtpd/0.29) with SMTP; Thu, 16 Dec 2010 17:46:32 +0000 Received: from source ([74.125.82.54]) by na3sys009aob101.postini.com ([74.125.148.12]) with SMTP ID DSNKTQpQYVk22D/g7UVXkCwQJioa/6c0Ea9K@postini.com; Thu, 16 Dec 2010 09:46:11 PST Received: by wwb31 with SMTP id 31so2588871wwb.23 for ; Thu, 16 Dec 2010 09:46:09 -0800 (PST) Received: by 10.216.181.141 with SMTP id l13mr2999756wem.22.1292521195245; Thu, 16 Dec 2010 09:39:55 -0800 (PST) MIME-Version: 1.0 Received: by 10.216.171.17 with HTTP; Thu, 16 Dec 2010 09:39:34 -0800 (PST) In-Reply-To: References: From: "Amin Sakka, Novapost" Date: Thu, 16 Dec 2010 18:39:34 +0100 Message-ID: Subject: Re: Too many open files Exception + java.lang.ArithmeticException: / by zero To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=0016367b60fab5cf3a04978a8aec --0016367b60fab5cf3a04978a8aec Content-Type: text/plain; charset=ISO-8859-1 I'm using a unique client instance (using Hector) and a unique connection to cassandra. For each insertion I'm using a new mutator and then I release it. I have 473 sstable "Data.db", the average size of each is 30Mo. 2010/12/16 Ryan King > Are you creating a new connection for each row you insert (and if so > are you closing it)? > > -ryan > > On Wed, Dec 15, 2010 at 8:13 AM, Amin Sakka, Novapost > wrote: > > Hello, > > I'm using cassandra 0.7.0 rc1, a single node configuration, replication > > factor 1, random partitioner, 2 GO heap size. > > I ran my hector client to insert 5.000.000 rows but after a couple of > hours, > > the following Exception occurs : > > > > WARN [main] 2010-12-15 16:38:53,335 CustomTThreadPoolServer.java (line > 104) > > Transport error occurred during acceptance of message. > > org.apache.thrift.transport.TTransportException: > java.net.SocketException: > > Too many open files > > at > > > org.apache.thrift.transport.TServerSocket.acceptImpl(TServerSocket.java:124) > > at > > > org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:67) > > at > > > org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:38) > > at > > > org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:31) > > at > > > org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:98) > > at > > > org.apache.cassandra.thrift.CassandraDaemon.start(CassandraDaemon.java:120) > > at > > > org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:229) > > at > > > org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:134) > > Caused by: java.net.SocketException: Too many open files > > at java.net.PlainSocketImpl.socketAccept(Native Method) > > at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) > > at java.net.ServerSocket.implAccept(ServerSocket.java:453) > > at java.net.ServerSocket.accept(ServerSocket.java:421) > > at > > > org.apache.thrift.transport.TServerSocket.acceptImpl(TServerSocket.java:119) > > > > When I try to restart Cassandra, I have the following exception : > > > > ERROR 16:42:26,573 Exception encountered during startup. > > java.lang.ArithmeticException: / by zero > > at > > > org.apache.cassandra.io.sstable.SSTable.estimateRowsFromIndex(SSTable.java:233) > > at > > > org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:284) > > at > > > org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:200) > > at > > > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:225) > > at > > > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:449) > > at > > > org.apache.cassandra.db.ColumnFamilyStore.addIndex(ColumnFamilyStore.java:306) > > at > > > org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:246) > > at > > > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:449) > > at > > > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:437) > > at org.apache.cassandra.db.Table.initCf(Table.java:341) > > at org.apache.cassandra.db.Table.(Table.java:283) > > at org.apache.cassandra.db.Table.open(Table.java:114) > > at > > > org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:138) > > at > > > org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java:55) > > at > > > org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:216) > > at > > > org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:134) > > > > I am looking for advice on how to debug this. > > > > Thanks, > > -- > > > > Amin > > > > > > > > > > > -- *Amin * --0016367b60fab5cf3a04978a8aec Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

I'm using a unique client instance (using Hector) and a = unique connection to cassandra.=A0
For each insertion I'm using a n= ew mutator and then I release it.
I have 473 =A0sstable "Data.db", the average size of= each is 30Mo.=A0

<= span class=3D"Apple-style-span" style=3D"border-collapse: collapse;">


2010/12/16 Ryan King = <ryan@twitter.com<= /a>>
Are you creating a new connection for each row you insert (and if so
are you closing it)?

-ryan

On Wed, Dec 15, 2010 at 8:13 AM, Amin Sakka, Novapost
<amin.sakka@= novapost.fr> wrote:
> Hello,
> I'm using cassandra 0.7.0 rc1, a single node configuration, replic= ation
> factor 1, random partitioner, 2 GO heap size.
> I ran my hector client to insert 5.000.000 rows but after a couple of = hours,
> the following Exception occurs :
>
> =A0WARN [main] 2010-12-15 16:38:53,335 CustomTThreadPoolServer.java (l= ine 104)
> Transport error occurred during acceptance of message.
> org.apache.thrift.transport.TTransportException: java.net.SocketExcept= ion:
> Too many open files
> at
> org.apache.thrift.transport.TServerSocket.acceptImpl(TServerSocket.jav= a:124)
> at
> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServ= erSocket.java:67)
> at
> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServ= erSocket.java:38)
> at
> org.apache.thrift.transport.TServerTransport.accept(TServerTransport.j= ava:31)
> at
> org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThrea= dPoolServer.java:98)
> at
> org.apache.cassandra.thrift.CassandraDaemon.start(CassandraDaemon.java= :120)
> at
> org.apache.cassandra.service.AbstractCassandraDaemon.activate(Abstract= CassandraDaemon.java:229)
> at
> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:= 134)
> Caused by: java.net.SocketException: Too many open files
> at java.net.PlainSocketImpl.socketAccept(Native Method)
> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
> at java.net.ServerSocket.implAccept(ServerSocket.java:453)
> at java.net.ServerSocket.accept(ServerSocket.java:421)
> at
> org.apache.thrift.transport.TServerSocket.acceptImpl(TServerSocket.jav= a:119)
>
> When I try to restart Cassandra, I have the following exception :
>
> ERROR 16:42:26,573 Exception encountered during startup.
> java.lang.ArithmeticException: / by zero
> at
> org.apache.cassandra.io.sstable.SSTable.estimateRowsFromIndex(SSTable.= java:233)
> at
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:= 284)
> at
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:= 200)
> at
> org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilySto= re.java:225)
> at
> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu= mnFamilyStore.java:449)
> at
> org.apache.cassandra.db.ColumnFamilyStore.addIndex(ColumnFamilyStore.j= ava:306)
> at
> org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilySto= re.java:246)
> at
> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu= mnFamilyStore.java:449)
> at
> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu= mnFamilyStore.java:437)
> at org.apache.cassandra.db.Table.initCf(Table.java:341)
> at org.apache.cassandra.db.Table.<init>(Table.java:283)
> at org.apache.cassandra.db.Table.open(Table.java:114)
> at
> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCas= sandraDaemon.java:138)
> at
> org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java= :55)
> at
> org.apache.cassandra.service.AbstractCassandraDaemon.activate(Abstract= CassandraDaemon.java:216)
> at
> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:= 134)
>
> I am looking for advice on how to debug this.
>
> Thanks,
> --
>
> Amin
>
>
>
>
>



--
Amin



--0016367b60fab5cf3a04978a8aec--