Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: <AANLkTikbGrytmpkPDNQxktKh72_4dOQho_zRTmZ44TSW@mail.gmail.com>
References: <AANLkTikmdsrrLGmDMP4tt9eHjwBysAz9VFjbWJFjupSO@mail.gmail.com>
	<AANLkTin1v_JN0Fb9cBTbKrN2Fxc2t6LsiOpd0K62z8Bv@mail.gmail.com>
	<AANLkTikbGrytmpkPDNQxktKh72_4dOQho_zRTmZ44TSW@mail.gmail.com>
Date: Thu, 16 Dec 2010 11:45:13 -0600
Message-ID: <AANLkTimHS4FYZ+5k_txCfOJU3D0iae8o_w9kOFk4V0zN@mail.gmail.com>
Subject: Re: Too many open files Exception + java.lang.ArithmeticException: /
 by zero
From: Nate McCall <nate@riptano.com>
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

You probably want to switch to using mutator#addInsertion for some
number of iterations (start with 1000 and adjust as needed), then
calling execute(). This will be much more efficient.

On Thu, Dec 16, 2010 at 11:39 AM, Amin Sakka, Novapost
<amin.sakka@novapost.fr> wrote:
>
> I'm using a unique client instance (using Hector) and a unique connection=
 to
> cassandra.
> For each insertion I'm using a new mutator and then I release it.
> I have 473 =A0sstable "Data.db", the average size of each is 30Mo.
>
>
>
> 2010/12/16 Ryan King <ryan@twitter.com>
>>
>> Are you creating a new connection for each row you insert (and if so
>> are you closing it)?
>>
>> -ryan
>>
>> On Wed, Dec 15, 2010 at 8:13 AM, Amin Sakka, Novapost
>> <amin.sakka@novapost.fr> wrote:
>> > Hello,
>> > I'm using cassandra 0.7.0 rc1, a single node configuration, replicatio=
n
>> > factor 1, random partitioner, 2 GO heap size.
>> > I ran my hector client to insert 5.000.000 rows but after a couple of
>> > hours,
>> > the following Exception occurs :
>> >
>> > =A0WARN [main] 2010-12-15 16:38:53,335 CustomTThreadPoolServer.java (l=
ine
>> > 104)
>> > Transport error occurred during acceptance of message.
>> > org.apache.thrift.transport.TTransportException:
>> > java.net.SocketException:
>> > Too many open files
>> > at
>> >
>> > org.apache.thrift.transport.TServerSocket.acceptImpl(TServerSocket.jav=
a:124)
>> > at
>> >
>> > org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServ=
erSocket.java:67)
>> > at
>> >
>> > org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServ=
erSocket.java:38)
>> > at
>> >
>> > org.apache.thrift.transport.TServerTransport.accept(TServerTransport.j=
ava:31)
>> > at
>> >
>> > org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThrea=
dPoolServer.java:98)
>> > at
>> >
>> > org.apache.cassandra.thrift.CassandraDaemon.start(CassandraDaemon.java=
:120)
>> > at
>> >
>> > org.apache.cassandra.service.AbstractCassandraDaemon.activate(Abstract=
CassandraDaemon.java:229)
>> > at
>> >
>> > org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:=
134)
>> > Caused by: java.net.SocketException: Too many open files
>> > at java.net.PlainSocketImpl.socketAccept(Native Method)
>> > at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
>> > at java.net.ServerSocket.implAccept(ServerSocket.java:453)
>> > at java.net.ServerSocket.accept(ServerSocket.java:421)
>> > at
>> >
>> > org.apache.thrift.transport.TServerSocket.acceptImpl(TServerSocket.jav=
a:119)
>> >
>> > When I try to restart Cassandra, I have the following exception :
>> >
>> > ERROR 16:42:26,573 Exception encountered during startup.
>> > java.lang.ArithmeticException: / by zero
>> > at
>> >
>> > org.apache.cassandra.io.sstable.SSTable.estimateRowsFromIndex(SSTable.=
java:233)
>> > at
>> >
>> > org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:=
284)
>> > at
>> >
>> > org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:=
200)
>> > at
>> >
>> > org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.jav=
a:225)
>> > at
>> >
>> > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu=
mnFamilyStore.java:449)
>> > at
>> >
>> > org.apache.cassandra.db.ColumnFamilyStore.addIndex(ColumnFamilyStore.j=
ava:306)
>> > at
>> >
>> > org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.jav=
a:246)
>> > at
>> >
>> > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu=
mnFamilyStore.java:449)
>> > at
>> >
>> > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu=
mnFamilyStore.java:437)
>> > at org.apache.cassandra.db.Table.initCf(Table.java:341)
>> > at org.apache.cassandra.db.Table.<init>(Table.java:283)
>> > at org.apache.cassandra.db.Table.open(Table.java:114)
>> > at
>> >
>> > org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCas=
sandraDaemon.java:138)
>> > at
>> >
>> > org.apache.cassandra.thrift.CassandraDaemon.setup(CassandraDaemon.java=
:55)
>> > at
>> >
>> > org.apache.cassandra.service.AbstractCassandraDaemon.activate(Abstract=
CassandraDaemon.java:216)
>> > at
>> >
>> > org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:=
134)
>> >
>> > I am looking for advice on how to debug this.
>> >
>> > Thanks,
>> > --
>> >
>> > Amin
>> >
>> >
>> >
>> >
>> >
>
>
>
> --
> Amin
>
>
>
>