Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
From: Jeff Ferland <jbf@tubularlabs.com>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Subject: Offline Compaction and Token Splitting
Message-Id: <34A710B2-F95D-42E9-87EB-C504DC737E40@tubularlabs.com>
Date: Thu, 7 May 2015 12:07:21 -0700
To: user@cassandra.apache.org
Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2098\))

I have an ideal for backups in my mind with Cassandra to dump each =
columnfamily to a directory and use an offline process to compact them =
all into one sstable (or max sstable size set). I have an ideal for =
restoration which involves a streaming read an sstable set and output =
based on whether the data fits within a token range. The result of this =
is that I can store a single copy of data that is effectively already =
repaired and can read from the specific range that covers a node that I =
wish to restore. My first look at this was somewhat frustrated by =
sstable code in the current versions have a strong reliance on the =
system keyspace.

Does anybody have any thoughts in regards to other things that might =
exist and fulfill this (particularly offline collective compaction), =
have a desire for such tools, or have any useful information for me =
before I attempt to build such beasts?

-Jeff=