Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C4D3D4DF2 for ; Sat, 4 Jun 2011 22:10:16 +0000 (UTC) Received: (qmail 20282 invoked by uid 500); 4 Jun 2011 22:10:14 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 20256 invoked by uid 500); 4 Jun 2011 22:10:14 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 20248 invoked by uid 99); 4 Jun 2011 22:10:14 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Jun 2011 22:10:14 +0000 X-ASF-Spam-Status: No, hits=0.6 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [74.125.149.238] (HELO na3sys009aog115.obsmtp.com) (74.125.149.238) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Jun 2011 22:10:07 +0000 Received: from mail-qw0-f52.google.com ([209.85.216.52]) (using TLSv1) by na3sys009aob115.postini.com ([74.125.148.12]) with SMTP ID DSNKTeqtKZCAj9Ajoc1WU2ieSVfnBE9xykNY@postini.com; Sat, 04 Jun 2011 15:09:46 PDT Received: by qwb8 with SMTP id 8so1441340qwb.25 for ; Sat, 04 Jun 2011 15:09:44 -0700 (PDT) Received: by 10.224.74.72 with SMTP id t8mr908189qaj.263.1307225383129; Sat, 04 Jun 2011 15:09:43 -0700 (PDT) MIME-Version: 1.0 Received: by 10.224.10.196 with HTTP; Sat, 4 Jun 2011 15:09:13 -0700 (PDT) In-Reply-To: References: From: Mario Micklisch Date: Sun, 5 Jun 2011 00:09:13 +0200 Message-ID: Subject: Re: problems with many columns on a row To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=0015175cb8569a544804a4ea2045 --0015175cb8569a544804a4ea2045 Content-Type: text/plain; charset=ISO-8859-1 Yes, checked the log file, no errors there. With debug logging it confirms to receive the write too and it is also in the commitlog. DEBUG 22:00:14,057 insert writing local RowMutation(keyspace='TestKS', key='44656661756c747c65333332356231342d373937392d313165302d613663382d3132333133633033336163347c5461626c65737c5765625369746573', modifications=[CFTest]) DEBUG 22:00:14,057 applying mutation of row 44656661756c747c65333332356231342d373937392d313165302d613663382d3132333133633033336163347c5461626c65737c5765625369746573 But doing compact with the nodetool triggered an error: ERROR [CompactionExecutor:8] 2011-06-04 21:47:44,021 CompactionManager.java (line 510) insufficient space to compact even the two smallest files, aborting ERROR [CompactionExecutor:8] 2011-06-04 21:47:44,024 CompactionManager.java (line 510) insufficient space to compact even the two smallest files, aborting The data folder has currently a size of about 1GB, there are 150GB free disk space on the volume where I pointed all cassandra directories but only 3.5GB free disk space on the operating system disk. Could this be the reason? How can I set the environment variables to let it only use the dedicated volume? Trying to use sstable2json did not work (throws an exception, am I using the wrong parameter?): # sstable2json ./CFTest-g-40-Data.db log4j:WARN No appenders could be found for logger (org.apache.cassandra.config.DatabaseDescriptor). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. { Exception in thread "main" java.lang.NullPointerException at org.apache.cassandra.db.ColumnFamily.(ColumnFamily.java:82) at org.apache.cassandra.db.ColumnFamily.create(ColumnFamily.java:70) at org.apache.cassandra.io.sstable.SSTableIdentityIterator.(SSTableIdentityIterator.java:142) at org.apache.cassandra.io.sstable.SSTableIdentityIterator.(SSTableIdentityIterator.java:90) at org.apache.cassandra.io.sstable.SSTableIdentityIterator.(SSTableIdentityIterator.java:74) at org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:179) at org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:144) at org.apache.cassandra.io.sstable.SSTableScanner.next(SSTableScanner.java:136) at org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:313) at org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:344) at org.apache.cassandra.tools.SSTableExport.export(SSTableExport.java:357) at org.apache.cassandra.tools.SSTableExport.main(SSTableExport.java:415) Cheers, Mario 2011/6/4 Jonathan Ellis > Did you check the server log for errors? > > See if the problem persists after running nodetool compact. If it > does, use sstable2json to export the row in question. > --0015175cb8569a544804a4ea2045 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Yes, checked the log file, no errors there.

With debug l= ogging it confirms to receive the write too and it is also in the commitlog= .

DEBUG 22:00:14,057 insert writing local Row= Mutation(keyspace=3D'TestKS', key=3D'44656661756c747c6533333235= 6231342d373937392d313165302d613663382d3132333133633033336163347c5461626c657= 37c5765625369746573', modifications=3D[CFTest])
DEBUG 22:00:14,057 applying mutation of row 44656661756c747c6533333235= 6231342d373937392d313165302d613663382d3132333133633033336163347c5461626c657= 37c5765625369746573


But doing compa= ct with the nodetool triggered an error:

ERROR [CompactionExecutor:8] 2011-06-04 21:47:44,0= 21 CompactionManager.java (line 510) insufficient space to compact even the= two smallest files, aborting
ERROR [CompactionExecutor:8] 2011-0= 6-04 21:47:44,024 CompactionManager.java (line 510) insufficient space to c= ompact even the two smallest files, aborting =A0=A0

The data folder has currently a size of about 1GB= , there are 150GB free disk space on the volume where I pointed all cassand= ra directories but only 3.5GB free disk space on the operating system disk.=

Could this be the reason? How can I set the environment= variables to let it only use the dedicated volume?


Trying to use sstable2json did not work (throws an excepti= on, am I using the wrong parameter?):

# sstable2json ./CFTest-g-40-Data.db =A0
log4j:WARN No appenders could be found for logger (org.apache.cassandra.co= nfig.DatabaseDescriptor).
log4j:WARN Please initialize the log4j = system properly.
{
Exception in thread "= main" java.lang.NullPointerException
at org.apache.cassandra.d= b.ColumnFamily.<init>(ColumnFamily.java:82)
at org.apache.cassandra.db.ColumnFamily.creat= e(ColumnFamily.java:70)
at org.apache.cassandra.i= o.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java= :142)
at org.apache.= cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIt= erator.java:90)
at org.apache.cassandra.i= o.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java= :74)
at org.apache.c= assandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.= java:179)
at org.apache.cassandra.i= o.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:144)<= /div>
at org.apache.cassan= dra.io.sstable.SSTableScanner.next(SSTableScanner.java:136)
at org.apache.cassandra.t= ools.SSTableExport.export(SSTableExport.java:313)
at org.apache.cassandra.tools.SSTableExport.e= xport(SSTableExport.java:344)
at org.apache.cassandra.t= ools.SSTableExport.export(SSTableExport.java:357)
at org.apache.cassandra.tools.SSTableExport.m= ain(SSTableExport.java:415)



Cheers,
=A0Mario

2011/6/4 J= onathan Ellis <jbellis@gmail.com>
Did you check the server log for errors?

See if the problem persists after running nodetool compact. If it
does, use sstable2json to export the row in question.
--0015175cb8569a544804a4ea2045--