incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aaron morton <aa...@thelastpickle.com>
Subject Re: problems with many columns on a row
Date Sun, 05 Jun 2011 23:37:45 GMT
Ops, I misread "150 GB" in one of your earlier emails as "150 MB" so forget what I said before.
You have loads of free space :)

How many files do you have in your data directory ? If it's 1 then that log message was a
small bug, that has been fixed.

Cheers
 
-----------------
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com

On 5 Jun 2011, at 23:51, Mario Micklisch wrote:

> I found a patch for the php extension here:
> 
> https://issues.apache.org/jira/browse/THRIFT-1067
> 
> … this seemed to fix the issue. Thank you Jonathan and Aaron for taking time to provide
me with some help!
> 
> Regarding the compaction I would still love to hear your feedback on how to configure
Cassandra accordingly.
> 
> Here are my facts again:
> 
> Data size on disk: ~1GB
> Data Volume: ~150GB free storage
> OS Volume: ~3GB free storage
> 
> Tried:
> nodetool --host localhost compact
> 
> The logfiles said:
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,346 CompactionManager.java (line 510)
insufficient space to compact even the two smallest files, aborting
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,348 CompactionManager.java (line 510)
insufficient space to compact even the two smallest files, aborting
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,349 CompactionManager.java (line 510)
insufficient space to compact even the two smallest files, aborting
>  INFO [CompactionExecutor:2] 2011-06-05 11:44:39,366 CompactionManager.java (line 539)
Compacting Major: [SSTableReader(path='/mnt/cassandra/data/system/LocationInfo-g-81-Data.db'),
SSTableReader(path='/mnt/cassandra/data/system/LocationInfo-g-80-Data.db'), SSTableReader(path='/mnt/cassandra/data/system/LocationInfo-g-79-Data.db')]
>  INFO [CompactionExecutor:2] 2011-06-05 11:44:39,502 CompactionIterator.java (line 186)
Major@23231510(system, LocationInfo, 386/689) now compacting at 16777 bytes/ms.
>  INFO [CompactionExecutor:2] 2011-06-05 11:44:39,713 CompactionManager.java (line 603)
Compacted to /mnt/cassandra/data/system/LocationInfo-tmp-g-82-Data.db.  689 to 446 (~64% of
original) bytes for 3 keys.  Time: 346ms.
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java (line 510)
insufficient space to compact even the two smallest files, aborting
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java (line 510)
insufficient space to compact even the two smallest files, aborting
> 
> # du -hs /mnt/cassandra/
> 886M	/mnt/cassandra/
> 
> # df -H
> Filesystem             Size   Used  Avail Use% Mounted on
> /dev/sda1              8.5G   4.9G   3.6G  49% /
> /dev/sda2              158G   1.2G   149G   1% /mnt
> 
> 
> # nodetool --host localhost info
> 130915841875673808436922706546793999597
> Gossip active    : true
> Load             : 1.48 MB
> Generation No    : 1307273982
> Uptime (seconds) : 383
> Heap Memory (MB) : 89.59 / 822.00
> 
> 
> Thank you,
>  Mario
> 
> 
> 
> 2011/6/5 Mario Micklisch <mario.micklisch@hpm-kommunikation.de>
> I tracked down the timestamp submission and everything was fine within the PHP Libraries.
> 
> The thrift php extension however seems to have an overflow, because it was now setting
now timestamps with also negative values ( -1242277493 ). I disabled the php extension and
as a result I now got correct microsecond timestamps: 1307270937122897
> 
> I was using the latest version from http://www.apache.org/dist/thrift/0.6.1/ to build
the extension without using any special parameters (just ./configure --enable-gen-php=yes
and make install).
> 
> Downloaded and re-compiled it, without any change. I can also  see no compile parameters
to set which might help.
> 
> 
> 
> Any advise where to go from here?
> 
> 
> 
> Thanks so far!
> 
>  Mario
> 
> 


Mime
View raw message