Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 52AA978D4 for ; Wed, 28 Sep 2011 15:47:13 +0000 (UTC) Received: (qmail 50516 invoked by uid 500); 28 Sep 2011 15:47:13 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 50472 invoked by uid 500); 28 Sep 2011 15:47:13 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 50463 invoked by uid 99); 28 Sep 2011 15:47:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Sep 2011 15:47:13 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Sep 2011 15:47:10 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id CF9D52388994 for ; Wed, 28 Sep 2011 15:46:48 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1176926 - in /cassandra/branches/cassandra-0.8: CHANGES.txt src/java/org/apache/cassandra/db/compaction/CompactionManager.java Date: Wed, 28 Sep 2011 15:46:48 -0000 To: commits@cassandra.apache.org From: xedin@apache.org X-Mailer: svnmailer-1.0.8-patched Message-Id: <20110928154648.CF9D52388994@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: xedin Date: Wed Sep 28 15:46:48 2011 New Revision: 1176926 URL: http://svn.apache.org/viewvc?rev=1176926&view=rev Log: Fix Scrub compaction finishing patch by Pavel Yaskevich; reviewed by Jonathan Ellis for (CASSANDRA-3255) Modified: cassandra/branches/cassandra-0.8/CHANGES.txt cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/compaction/CompactionManager.java Modified: cassandra/branches/cassandra-0.8/CHANGES.txt URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.8/CHANGES.txt?rev=1176926&r1=1176925&r2=1176926&view=diff ============================================================================== --- cassandra/branches/cassandra-0.8/CHANGES.txt (original) +++ cassandra/branches/cassandra-0.8/CHANGES.txt Wed Sep 28 15:46:48 2011 @@ -12,7 +12,7 @@ contains non-hex characters (CASSANDRA-3231) * Keep SimpleSnitch proximity ordering unchanged from what the Strategy generates, as intended (CASSANDRA-3262) - + * fix Scrub compaction finishing (CASSANDRA-3255) 0.8.6 * revert CASSANDRA-2388 Modified: cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/compaction/CompactionManager.java URL: http://svn.apache.org/viewvc/cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/compaction/CompactionManager.java?rev=1176926&r1=1176925&r2=1176926&view=diff ============================================================================== --- cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/compaction/CompactionManager.java (original) +++ cassandra/branches/cassandra-0.8/src/java/org/apache/cassandra/db/compaction/CompactionManager.java Wed Sep 28 15:46:48 2011 @@ -655,6 +655,8 @@ public class CompactionManager implement final BufferedRandomAccessFile dataFile = BufferedRandomAccessFile.getUncachingReader(sstable.getFilename()); String indexFilename = sstable.descriptor.filenameFor(Component.PRIMARY_INDEX); BufferedRandomAccessFile indexFile = BufferedRandomAccessFile.getUncachingReader(indexFilename); + ScrubInfo scrubInfo = new ScrubInfo(dataFile, sstable); + try { ByteBuffer nextIndexKey = ByteBufferUtil.readWithShortLength(indexFile); @@ -664,10 +666,16 @@ public class CompactionManager implement assert firstRowPositionFromIndex == 0 : firstRowPositionFromIndex; } - SSTableWriter writer = maybeCreateWriter(cfs, compactionFileLocation, expectedBloomFilterSize, null, Collections.singletonList(sstable)); - executor.beginCompaction(new ScrubInfo(dataFile, sstable)); + SSTableWriter writer = maybeCreateWriter(cfs, + compactionFileLocation, + expectedBloomFilterSize, + null, + Collections.singletonList(sstable)); + int goodRows = 0, badRows = 0, emptyRows = 0; + executor.beginCompaction(scrubInfo); + while (!dataFile.isEOF()) { long rowStart = dataFile.getFilePointer(); @@ -807,6 +815,8 @@ public class CompactionManager implement { FileUtils.closeQuietly(dataFile); FileUtils.closeQuietly(indexFile); + + executor.finishCompaction(scrubInfo); } }