From user-return-28955-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Thu Sep 20 19:55:54 2012 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D4DFED961 for ; Thu, 20 Sep 2012 19:55:54 +0000 (UTC) Received: (qmail 77429 invoked by uid 500); 20 Sep 2012 19:55:52 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 77372 invoked by uid 500); 20 Sep 2012 19:55:52 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 77361 invoked by uid 99); 20 Sep 2012 19:55:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Sep 2012 19:55:52 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of synfinatic@gmail.com designates 209.85.214.172 as permitted sender) Received: from [209.85.214.172] (HELO mail-ob0-f172.google.com) (209.85.214.172) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Sep 2012 19:55:46 +0000 Received: by obbwc20 with SMTP id wc20so2840471obb.31 for ; Thu, 20 Sep 2012 12:55:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=gvSF80s5g55tjO5umFrg5NRr0BOlmb9VFGDtV+heKCU=; b=QYPSwvE9d2/5qrtPvdFuCcEFS1/fQ7htRgqPjBAeVhyY7XGgCj3tO15h0UPbKELDuL XHUzZ0HcQZJkIPJ3uF7k9BkOjZYzNAvLrQYJH7yNoAXAZzK7XMc4wiPPEpYbOXVZwl9S 0PCeh/GdLfyHRJxCxRB+TRUHsNOt9Gw9j0Cmu+1j0gsUWygwDVAwjvn/FGcMaCFb9H3E xBahkkfDlQd7nZG50rMmxXf+5UA7hgkFbXYIeLNn0S/m6eJc65RlxOc9Km2h9s+vNn8c 0MMADjkymCGo+K1dSBhgfRMPaJn36Uu2IJgg7x2+G/utpwpyWGB+5kca6jGI4MfiSZJf fKlw== Received: by 10.182.177.7 with SMTP id cm7mr2160222obc.17.1348170925480; Thu, 20 Sep 2012 12:55:25 -0700 (PDT) MIME-Version: 1.0 Received: by 10.60.42.166 with HTTP; Thu, 20 Sep 2012 12:55:04 -0700 (PDT) In-Reply-To: References: From: Aaron Turner Date: Thu, 20 Sep 2012 20:55:04 +0100 Message-ID: Subject: Re: any ways to have compaction use less disk space? To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 1. Use compression 2. Used Leveled Compaction Also, 1TB/node is a lot larger then the normal recommendation... generally speaking more in the 300-400GB range. On Thu, Sep 20, 2012 at 8:10 PM, Hiller, Dean wrote: > While diskspace is cheap, nodes are not that cheap, and usually systems have a 1T limit on each node which means we would love to really not add more nodes until we hit 70% disk space instead of the normal 50% that we have read about due to compaction. > > Is there any way to use less disk space during compactions? > Is there any work being done so that compactions take less space in the future meaning we can buy less nodes? > > Thanks, > Dean -- Aaron Turner http://synfin.net/ Twitter: @synfinatic http://tcpreplay.synfin.net/ - Pcap editing and replay tools for Unix & Windows Those who would give up essential Liberty, to purchase a little temporary Safety, deserve neither Liberty nor Safety. -- Benjamin Franklin "carpe diem quam minimum credula postero"