Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 80D9E9B2E for ; Tue, 8 Nov 2011 04:12:06 +0000 (UTC) Received: (qmail 37129 invoked by uid 500); 8 Nov 2011 04:12:04 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 37107 invoked by uid 500); 8 Nov 2011 04:12:04 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 37098 invoked by uid 99); 8 Nov 2011 04:12:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Nov 2011 04:12:03 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of colin.taylor@gmail.com designates 209.85.161.44 as permitted sender) Received: from [209.85.161.44] (HELO mail-fx0-f44.google.com) (209.85.161.44) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Nov 2011 04:11:56 +0000 Received: by faas12 with SMTP id s12so126607faa.31 for ; Mon, 07 Nov 2011 20:11:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=UmG1iq2WcV2Oj54h4nrYUTKEkC6JtZV63IQ8A8CgIs8=; b=WFxDRDCzDv70IJq7f2uVAytaC/D0a7a3Gnjc2c6ousrOxKZK95UFpIrIfJiP+s/JFR gJSjCZfutqfl5goaV7nW3f00N6CpH8R/xpoNRnJdtfDUC/kVCrZFmdhgFzY2SNzvTGJQ EZ0ai/Z4gnvUCFPrWFdYyFBKZd89wL8QxRM/I= MIME-Version: 1.0 Received: by 10.223.92.135 with SMTP id r7mr37309874fam.35.1320725494679; Mon, 07 Nov 2011 20:11:34 -0800 (PST) Received: by 10.223.74.131 with HTTP; Mon, 7 Nov 2011 20:11:34 -0800 (PST) In-Reply-To: References: Date: Tue, 8 Nov 2011 17:11:34 +1300 Message-ID: Subject: Re: Second Cassandra users survey From: Colin Taylor To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 Decompression without compression (for lack of a better name). We store into Cassandra log batches that come in over http either uncompressed, deflate, snappy. We just add 'magic e.g. \0 \s \n \a \p \p \y as a prefix to the column value so we can decode it when serve it back up. Seems like Cassandra could detect data with the appropriate magic, store as is and decode for us automatically on the way back. Colin.