cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jackson Chung (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-3496) Load from `nodetool ring` does not update after cleanup.
Date Tue, 15 Nov 2011 20:34:52 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150750#comment-13150750
] 

Jackson Chung commented on CASSANDRA-3496:
------------------------------------------

my test case (which seems difference from Ben's?):
1) put a break between the releaseReference and releaseReference
2) insert to a CF, flush, insert again, flush, now you have 2 sstables
3) force major compaction

with the following break/sleep in the test:

{code}
            sstable.releaseReference();
            try
            {
                logger.debug("xxxxxxxxxxxx zz for 10s");
                Thread.sleep(7000);
            }
            
            catch (InterruptedException e)
            {
                // TODO Auto-generated catch block
                e.printStackTrace();
            }
            long bytesOnDisk = sstable.bytesOnDisk();
            logger.debug("xxxxxxxxxx wake up -------- size to remove from livesize" + bytesOnDisk);
liveSize.addAndGet(-bytesOnDisk);
{code}

the following is observed in the log:
{noformat}
DEBUG [CompactionExecutor:6] 2011-11-15 12:29:43,050 DataTracker.java (line 345) removing
/var/lib/cassandra/data/testsize/testcfsize-hb-1 from list of files tracked for testsize.testcfsize
DEBUG [CompactionExecutor:6] 2011-11-15 12:29:43,050 SSTableReader.java (line 742) Marking
/var/lib/cassandra/data/testsize/testcfsize-hb-1-Data.db compacted
DEBUG [CompactionExecutor:6] 2011-11-15 12:29:43,050 MmappedSegmentedFile.java (line 139)
All segments have been unmapped successfully
DEBUG [CompactionExecutor:6] 2011-11-15 12:29:43,051 MmappedSegmentedFile.java (line 139)
All segments have been unmapped successfully
DEBUG [CompactionExecutor:6] 2011-11-15 12:29:43,051 DataTracker.java (line 353) xxxxxxxxxxxx
zz for 10s
DEBUG [NonPeriodicTasks:1] 2011-11-15 12:29:43,051 FileUtils.java (line 51) Deleting testcfsize-hb-1-Index.db
DEBUG [NonPeriodicTasks:1] 2011-11-15 12:29:43,051 FileUtils.java (line 51) Deleting testcfsize-hb-1-Filter.db
DEBUG [NonPeriodicTasks:1] 2011-11-15 12:29:43,052 FileUtils.java (line 51) Deleting testcfsize-hb-1-Digest.sha1
DEBUG [NonPeriodicTasks:1] 2011-11-15 12:29:43,052 FileUtils.java (line 51) Deleting testcfsize-hb-1-Statistics.db
DEBUG [NonPeriodicTasks:1] 2011-11-15 12:29:43,052 SSTable.java (line 144) Deleted /var/lib/cassandra/data/testsize/testcfsize-hb-1
DEBUG [CompactionExecutor:6] 2011-11-15 12:29:50,051 DataTracker.java (line 363) xxxxxxxxxx
wake up -------- size to remove from livesize0
{noformat}

cfstats:
                Column Family: testcfsize
                SSTable count: 1
                Space used (live): 14395
                Space used (total): 5491

                
> Load from `nodetool ring` does not update after cleanup.
> --------------------------------------------------------
>
>                 Key: CASSANDRA-3496
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3496
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.2
>            Reporter: Benjamin Coverston
>            Assignee: Sylvain Lebresne
>         Attachments: 3496.txt
>
>
> Repro:
> Bring up a node.
> Insert 1M rows:
> 127.0.0.1       datacenter1 rack1       Up     Normal  406.92 MB       100.00% 77747037169725419723056812679314618801
> (Already looks wrong, 406.92 is higher than I'm used to seeing from a single run of stress)
> Bootstrap a second node into the cluster:
> 162877269496252595336256012556853953561
> 127.0.0.1       datacenter1 rack1       Up     Normal  407.03 MB       49.96%  77747037169725419723056812679314618801
> 127.0.0.2       datacenter1 rack1       Up     Normal  157.91 MB       50.04%  162877269496252595336256012556853953561
> Cleanup
> 162877269496252595336256012556853953561
> 127.0.0.1       datacenter1 rack1       Up     Normal  551.2 MB       49.96%  77747037169725419723056812679314618801
> 127.0.0.2       datacenter1 rack1       Up     Normal  157.91 MB       50.04%  162877269496252595336256012556853953561
> Looks like each operation that adds and removes SSTables only adds to the total and doesn't
remove the old sstables from the total size count.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message