incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aaron morton <aa...@thelastpickle.com>
Subject Re: problems with many columns on a row
Date Mon, 06 Jun 2011 19:42:04 GMT
Can you upgrade to the official 0.8 release and try again with logging set to DEBUG ? 

Cheers

-----------------
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com

On 6 Jun 2011, at 23:41, Mario Micklisch wrote:

> :-)
> 
> There are several data Files:
> 
> # ls -al *-Data.db
> 
> 
> -rw-r--r-- 1 cassandra cassandra  53785327 2011-06-05 14:44 CFTest-g-21-Data.db
> -rw-r--r-- 1 cassandra cassandra  56474656 2011-06-05 18:04 CFTest-g-38-Data.db
> -rw-r--r-- 1 cassandra cassandra  21705904 2011-06-05 20:02 CFTest-g-45-Data.db
> -rw------- 1 cassandra cassandra   3720201 2011-06-05 20:13 CFTest-g-46-Data.db
> -rw-r--r-- 1 cassandra cassandra 135684874 2011-06-05 20:14 CFTest-g-47-Data.db
> -rw-r--r-- 1 cassandra cassandra   4347351 2011-06-05 20:35 CFTest-g-48-Data.db
> -rw-r--r-- 1 cassandra cassandra   4341698 2011-06-05 20:56 CFTest-g-49-Data.db
> -rw-r--r-- 1 cassandra cassandra   4350949 2011-06-05 21:17 CFTest-g-50-Data.db
> -rw-r--r-- 1 cassandra cassandra   4346066 2011-06-05 21:38 CFTest-g-51-Data.db
> -rw-r--r-- 1 cassandra cassandra  17384858 2011-06-05 21:39 CFTest-g-52-Data.db
> -rw-r--r-- 1 cassandra cassandra   4342983 2011-06-05 21:59 CFTest-g-53-Data.db
> -rw-r--r-- 1 cassandra cassandra   4339771 2011-06-05 22:21 CFTest-g-54-Data.db
> -rw-r--r-- 1 cassandra cassandra   4349165 2011-06-05 22:42 CFTest-g-55-Data.db
> -rw-r--r-- 1 cassandra cassandra  30415571 2011-06-05 22:42 CFTest-g-56-Data.db
> 
> 
> Cheers,
>  Mario
> 
> 
> 
> 
> 2011/6/6 aaron morton <aaron@thelastpickle.com>
> Ops, I misread "150 GB" in one of your earlier emails as "150 MB" so forget what I said
before. You have loads of free space :)
> 
> How many files do you have in your data directory ? If it's 1 then that log message was
a small bug, that has been fixed.
> 
> Cheers
>  
> -----------------
> Aaron Morton
> Freelance Cassandra Developer
> @aaronmorton
> http://www.thelastpickle.com
> 
> On 5 Jun 2011, at 23:51, Mario Micklisch wrote:
> 
>> I found a patch for the php extension here:
>> 
>> https://issues.apache.org/jira/browse/THRIFT-1067
>> 
>> … this seemed to fix the issue. Thank you Jonathan and Aaron for taking time to
provide me with some help!
>> 
>> Regarding the compaction I would still love to hear your feedback on how to configure
Cassandra accordingly.
>> 
>> Here are my facts again:
>> 
>> Data size on disk: ~1GB
>> Data Volume: ~150GB free storage
>> OS Volume: ~3GB free storage
>> 
>> Tried:
>> nodetool --host localhost compact
>> 
>> The logfiles said:
>> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,346 CompactionManager.java (line
510) insufficient space to compact even the two smallest files, aborting
>> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,348 CompactionManager.java (line
510) insufficient space to compact even the two smallest files, aborting
>> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,349 CompactionManager.java (line
510) insufficient space to compact even the two smallest files, aborting
>>  INFO [CompactionExecutor:2] 2011-06-05 11:44:39,366 CompactionManager.java (line
539) Compacting Major: [SSTableReader(path='/mnt/cassandra/data/system/LocationInfo-g-81-Data.db'),
SSTableReader(path='/mnt/cassandra/data/system/LocationInfo-g-80-Data.db'), SSTableReader(path='/mnt/cassandra/data/system/LocationInfo-g-79-Data.db')]
>>  INFO [CompactionExecutor:2] 2011-06-05 11:44:39,502 CompactionIterator.java (line
186) Major@23231510(system, LocationInfo, 386/689) now compacting at 16777 bytes/ms.
>>  INFO [CompactionExecutor:2] 2011-06-05 11:44:39,713 CompactionManager.java (line
603) Compacted to /mnt/cassandra/data/system/LocationInfo-tmp-g-82-Data.db.  689 to 446 (~64%
of original) bytes for 3 keys.  Time: 346ms.
>> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java (line
510) insufficient space to compact even the two smallest files, aborting
>> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java (line
510) insufficient space to compact even the two smallest files, aborting
>> 
>> # du -hs /mnt/cassandra/
>> 886M	/mnt/cassandra/
>> 
>> # df -H
>> Filesystem             Size   Used  Avail Use% Mounted on
>> /dev/sda1              8.5G   4.9G   3.6G  49% /
>> /dev/sda2              158G   1.2G   149G   1% /mnt
>> 
>> 
>> # nodetool --host localhost info
>> 130915841875673808436922706546793999597
>> Gossip active    : true
>> Load             : 1.48 MB
>> Generation No    : 1307273982
>> Uptime (seconds) : 383
>> Heap Memory (MB) : 89.59 / 822.00
>> 
>> 
>> Thank you,
>>  Mario
>> 
>> 
>> 
>> 2011/6/5 Mario Micklisch <mario.micklisch@hpm-kommunikation.de>
>> I tracked down the timestamp submission and everything was fine within the PHP Libraries.
>> 
>> The thrift php extension however seems to have an overflow, because it was now setting
now timestamps with also negative values ( -1242277493 ). I disabled the php extension and
as a result I now got correct microsecond timestamps: 1307270937122897
>> 
>> I was using the latest version from http://www.apache.org/dist/thrift/0.6.1/ to build
the extension without using any special parameters (just ./configure --enable-gen-php=yes
and make install).
>> 
>> Downloaded and re-compiled it, without any change. I can also  see no compile parameters
to set which might help.
>> 
>> 
>> 
>> Any advise where to go from here?
>> 
>> 
>> 
>> Thanks so far!
>> 
>>  Mario
>> 
>> 
> 
> 


Mime
View raw message