Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1750B617D for ; Sun, 5 Jun 2011 11:52:58 +0000 (UTC) Received: (qmail 95229 invoked by uid 500); 5 Jun 2011 11:52:56 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 95204 invoked by uid 500); 5 Jun 2011 11:52:56 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 95196 invoked by uid 99); 5 Jun 2011 11:52:56 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 05 Jun 2011 11:52:56 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_NEUTRAL,TRACKER_ID X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [74.125.149.75] (HELO na3sys009aog105.obsmtp.com) (74.125.149.75) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 05 Jun 2011 11:52:47 +0000 Received: from mail-qw0-f50.google.com ([209.85.216.50]) (using TLSv1) by na3sys009aob105.postini.com ([74.125.148.12]) with SMTP ID DSNKTett+TrqZm6OMWu45GwPkFa0fcF8+t+5@postini.com; Sun, 05 Jun 2011 04:52:26 PDT Received: by mail-qw0-f50.google.com with SMTP id 5so1958330qwe.23 for ; Sun, 05 Jun 2011 04:52:25 -0700 (PDT) Received: by 10.224.193.135 with SMTP id du7mr1137653qab.213.1307274744069; Sun, 05 Jun 2011 04:52:24 -0700 (PDT) MIME-Version: 1.0 Received: by 10.224.10.196 with HTTP; Sun, 5 Jun 2011 04:51:54 -0700 (PDT) In-Reply-To: References: From: Mario Micklisch Date: Sun, 5 Jun 2011 13:51:54 +0200 Message-ID: Subject: Re: problems with many columns on a row To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=20cf3005de96be7e2e04a4f59e24 X-Virus-Checked: Checked by ClamAV on apache.org --20cf3005de96be7e2e04a4f59e24 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable I found a patch for the php extension here: https://issues.apache.org/jira/browse/THRIFT-1067 =85 this seemed to fix the issue. Thank you Jonathan and Aaron for taking t= ime to provide me with some help! Regarding the compaction I would still love to hear your feedback on how to configure Cassandra accordingly. Here are my facts again: Data size on disk: ~1GB Data Volume: ~150GB free storage OS Volume: ~3GB free storage Tried: nodetool --host localhost compact The logfiles said: ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,346 CompactionManager.java (line 510) insufficient space to compact even the two smallest files, aborting ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,348 CompactionManager.java (line 510) insufficient space to compact even the two smallest files, aborting ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,349 CompactionManager.java (line 510) insufficient space to compact even the two smallest files, aborting INFO [CompactionExecutor:2] 2011-06-05 11:44:39,366 CompactionManager.java (line 539) Compacting Major: [SSTableReader(path=3D'/mnt/cassandra/data/system/LocationInfo-g-81-Data.db= '), SSTableReader(path=3D'/mnt/cassandra/data/system/LocationInfo-g-80-Data.db'= ), SSTableReader(path=3D'/mnt/cassandra/data/system/LocationInfo-g-79-Data.db'= )] INFO [CompactionExecutor:2] 2011-06-05 11:44:39,502 CompactionIterator.jav= a (line 186) Major@23231510(system, LocationInfo, 386/689) now compacting at 16777 bytes/ms. INFO [CompactionExecutor:2] 2011-06-05 11:44:39,713 CompactionManager.java (line 603) Compacted to /mnt/cassandra/data/system/LocationInfo-tmp-g-82-Data.db. 689 to 446 (~64% of original) bytes for 3 keys. Time: 346ms. ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java (line 510) insufficient space to compact even the two smallest files, aborting ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java (line 510) insufficient space to compact even the two smallest files, aborting # du -hs /mnt/cassandra/ 886M /mnt/cassandra/ # df -H Filesystem Size Used Avail Use% Mounted on /dev/sda1 8.5G 4.9G 3.6G 49% / /dev/sda2 158G 1.2G 149G 1% /mnt # nodetool --host localhost info 130915841875673808436922706546793999597 Gossip active : true Load : 1.48 MB Generation No : 1307273982 Uptime (seconds) : 383 Heap Memory (MB) : 89.59 / 822.00 Thank you, Mario 2011/6/5 Mario Micklisch > I tracked down the timestamp submission and everything was fine within th= e > PHP Libraries. > > The thrift php extension however seems to have an overflow, because it wa= s > now setting now timestamps with also negative values ( -1242277493 ). I > disabled the php extension and as a result I now got correct microsecond > timestamps: 1307270937122897 > > I was using the latest version from > http://www.apache.org/dist/thrift/0.6.1/ to build the extension without > using any special parameters (just ./configure --enable-gen-php=3Dyes and > make install). > > Downloaded and re-compiled it, without any change. I can also see no > compile parameters to set which might help. > > > Any advise where to go from here? > > > Thanks so far! > > Mario > > --20cf3005de96be7e2e04a4f59e24 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable

I found a patch for the php extension here:

=

https://is= sues.apache.org/jira/browse/THRIFT-1067

=85 this seemed to fix th= e issue. Thank you Jonathan and Aaron for taking time to provide me with so= me help!

Regarding the compaction I would still love to hear your feedback on = how to configure Cassandra accordingly.

Here are my fact= s again:

Data size on disk: ~1GB
Data Vo= lume: ~150GB free storage
OS Volume: ~3GB free storage

Tried:
nodetool --host localhost compact

The logfiles sa= id:
ERROR [CompactionExecutor:2] 2011-06-05 11:44:3= 9,346 CompactionManager.java (line 510) insufficient space to compact even = the two smallest files, aborting
ERROR [Compacti= onExecutor:2] 2011-06-05 11:44:39,348 CompactionManager.java (line 510) ins= ufficient space to compact even the two smallest files, aborting
ERROR [Compacti= onExecutor:2] 2011-06-05 11:44:39,349 CompactionManager.java (line 510) ins= ufficient space to compact even the two smallest files, aborting
=A0INFO [Compac= tionExecutor:2] 2011-06-05 11:44:39,366 CompactionManager.java (line 539) C= ompacting Major: [SSTableReader(path=3D'/mnt/cassandra/data/system/Loca= tionInfo-g-81-Data.db'), SSTableReader(path=3D'/mnt/cassandra/data/= system/LocationInfo-g-80-Data.db'), SSTableReader(path=3D'/mnt/cass= andra/data/system/LocationInfo-g-79-Data.db')]
=A0INFO [Compac= tionExecutor:2] 2011-06-05 11:44:39,502 CompactionIterator.java (line 186) = Major@23231510(system, LocationInfo, 386/689) now compacting at 16777 bytes= /ms.
=A0INFO [Compac= tionExecutor:2] 2011-06-05 11:44:39,713 CompactionManager.java (line 603) C= ompacted to /mnt/cassandra/data/system/LocationInfo-tmp-g-82-Data.db. =A068= 9 to 446 (~64% of original) bytes for 3 keys. =A0Time: 346ms.=
ERROR [Compacti= onExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java (line 510) ins= ufficient space to compact even the two smallest files, aborting
ERROR [Compacti= onExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java (line 510) ins= ufficient space to compact even the two smallest files, aborting

# du -hs /mnt/cassandra/
886M /mnt/cassandra/

# df -H
Filesystem =A0 = =A0 =A0 =A0 =A0 =A0 Size =A0 Used =A0Avail Use% Mounted on
/dev/sda1 = =A0 =A0 =A0 =A0 =A0 =A0 =A08.5G =A0 4.9G =A0 3.6G =A049% /
/dev/sda2 =A0 =A0 =A0 =A0 =A0 =A0 =A0158G = =A0 1.2G =A0 149G =A0 1% /mnt


# nodetool --host localhost info
130915841875673= 808436922706546793999597
Gossip active =A0 =A0: true
Load =A0 =A0 = =A0 =A0 =A0 =A0 : 1.48 MB
Generation No =A0 =A0: 1307273982
Uptime (seconds= ) : 383
Heap Memory (MB) : 89.59 / 822.00


=A0Mario

<= div>

2011/6/5 Mario Micklisch <mario.mickli= sch@hpm-kommunikation.de>

I tracked down the timestamp submission and eve= rything was fine within the PHP Libraries.

The thrift php extension h= owever seems to have an overflow, because it was now setting now timestamps= with also negative values (=A0-1242277493 ). I disabled the php extension = and as a result I now got correct microsecond timestamps:=A0130727093712289= 7

I was using the latest version from=A0http://www.apache.org/dist/thrift/0.6.1/ to build the ex= tension without using any special parameters (just=A0./configure --enable-gen-php=3Dyes an= d make install).

Downloaded and re-compiled it, without any change. I can also =A0see no = compile parameters to set which might help.


Any advise whe= re to go from here?


Thanks so far!

=A0Mario


--20cf3005de96be7e2e04a4f59e24--