cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mario Micklisch <mario.mickli...@hpm-kommunikation.de>
Subject Re: problems with many columns on a row
Date Mon, 06 Jun 2011 11:41:32 GMT
:-)

There are several data Files:

# ls -al *-Data.db

-rw-r--r-- 1 cassandra cassandra  53785327 2011-06-05 14:44
CFTest-g-21-Data.db
-rw-r--r-- 1 cassandra cassandra  56474656 2011-06-05 18:04
CFTest-g-38-Data.db
-rw-r--r-- 1 cassandra cassandra  21705904 2011-06-05 20:02
CFTest-g-45-Data.db
-rw------- 1 cassandra cassandra   3720201 2011-06-05 20:13
CFTest-g-46-Data.db
-rw-r--r-- 1 cassandra cassandra 135684874 2011-06-05 20:14
CFTest-g-47-Data.db
-rw-r--r-- 1 cassandra cassandra   4347351 2011-06-05 20:35
CFTest-g-48-Data.db
-rw-r--r-- 1 cassandra cassandra   4341698 2011-06-05 20:56
CFTest-g-49-Data.db
-rw-r--r-- 1 cassandra cassandra   4350949 2011-06-05 21:17
CFTest-g-50-Data.db
-rw-r--r-- 1 cassandra cassandra   4346066 2011-06-05 21:38
CFTest-g-51-Data.db
-rw-r--r-- 1 cassandra cassandra  17384858 2011-06-05 21:39
CFTest-g-52-Data.db
-rw-r--r-- 1 cassandra cassandra   4342983 2011-06-05 21:59
CFTest-g-53-Data.db
-rw-r--r-- 1 cassandra cassandra   4339771 2011-06-05 22:21
CFTest-g-54-Data.db
-rw-r--r-- 1 cassandra cassandra   4349165 2011-06-05 22:42
CFTest-g-55-Data.db
-rw-r--r-- 1 cassandra cassandra  30415571 2011-06-05 22:42
CFTest-g-56-Data.db

Cheers,
 Mario




2011/6/6 aaron morton <aaron@thelastpickle.com>

> Ops, I misread "150 GB" in one of your earlier emails as "150 MB" so forget
> what I said before. You have loads of free space :)
>
> How many files do you have in your data directory ? If it's 1 then that log
> message was a small bug, that has been fixed.
>
> Cheers
>
>  -----------------
> Aaron Morton
> Freelance Cassandra Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 5 Jun 2011, at 23:51, Mario Micklisch wrote:
>
> I found a patch for the php extension here:
>
> https://issues.apache.org/jira/browse/THRIFT-1067
>
> … this seemed to fix the issue. Thank you Jonathan and Aaron for taking
> time to provide me with some help!
> Regarding the compaction I would still love to hear your feedback on how to
> configure Cassandra accordingly.
>
> Here are my facts again:
>
> Data size on disk: ~1GB
> Data Volume: ~150GB free storage
> OS Volume: ~3GB free storage
>
> Tried:
> nodetool --host localhost compact
>
> The logfiles said:
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,346 CompactionManager.java
> (line 510) insufficient space to compact even the two smallest files,
> aborting
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,348 CompactionManager.java
> (line 510) insufficient space to compact even the two smallest files,
> aborting
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,349 CompactionManager.java
> (line 510) insufficient space to compact even the two smallest files,
> aborting
>  INFO [CompactionExecutor:2] 2011-06-05 11:44:39,366 CompactionManager.java
> (line 539) Compacting Major:
> [SSTableReader(path='/mnt/cassandra/data/system/LocationInfo-g-81-Data.db'),
> SSTableReader(path='/mnt/cassandra/data/system/LocationInfo-g-80-Data.db'),
> SSTableReader(path='/mnt/cassandra/data/system/LocationInfo-g-79-Data.db')]
>  INFO [CompactionExecutor:2] 2011-06-05 11:44:39,502
> CompactionIterator.java (line 186) Major@23231510(system, LocationInfo,
> 386/689) now compacting at 16777 bytes/ms.
>  INFO [CompactionExecutor:2] 2011-06-05 11:44:39,713 CompactionManager.java
> (line 603) Compacted to
> /mnt/cassandra/data/system/LocationInfo-tmp-g-82-Data.db.  689 to 446 (~64%
> of original) bytes for 3 keys.  Time: 346ms.
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java
> (line 510) insufficient space to compact even the two smallest files,
> aborting
> ERROR [CompactionExecutor:2] 2011-06-05 11:44:39,726 CompactionManager.java
> (line 510) insufficient space to compact even the two smallest files,
> aborting
>
> # du -hs /mnt/cassandra/
> 886M /mnt/cassandra/
>
> # df -H
> Filesystem             Size   Used  Avail Use% Mounted on
> /dev/sda1              8.5G   4.9G   3.6G  49% /
> /dev/sda2              158G   1.2G   149G   1% /mnt
>
>
> # nodetool --host localhost info
> 130915841875673808436922706546793999597
> Gossip active    : true
> Load             : 1.48 MB
> Generation No    : 1307273982
> Uptime (seconds) : 383
> Heap Memory (MB) : 89.59 / 822.00
>
>
> Thank you,
>  Mario
>
>
>
> 2011/6/5 Mario Micklisch <mario.micklisch@hpm-kommunikation.de>
>
>> I tracked down the timestamp submission and everything was fine within the
>> PHP Libraries.
>>
>> The thrift php extension however seems to have an overflow, because it was
>> now setting now timestamps with also negative values ( -1242277493 ). I
>> disabled the php extension and as a result I now got correct microsecond
>> timestamps: 1307270937122897
>>
>> I was using the latest version from
>> http://www.apache.org/dist/thrift/0.6.1/ to build the extension without
>> using any special parameters (just ./configure --enable-gen-php=yes and
>> make install).
>>
>> Downloaded and re-compiled it, without any change. I can also  see no
>> compile parameters to set which might help.
>>
>>
>> Any advise where to go from here?
>>
>>
>> Thanks so far!
>>
>>  Mario
>>
>>
>

Mime
View raw message