Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 58193 invoked from network); 19 Mar 2010 17:52:43 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 19 Mar 2010 17:52:43 -0000 Received: (qmail 16013 invoked by uid 500); 19 Mar 2010 17:52:42 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 15995 invoked by uid 500); 19 Mar 2010 17:52:42 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 15987 invoked by uid 99); 19 Mar 2010 17:52:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Mar 2010 17:52:42 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of tsaloranta@gmail.com designates 74.125.83.172 as permitted sender) Received: from [74.125.83.172] (HELO mail-pv0-f172.google.com) (74.125.83.172) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Mar 2010 17:52:35 +0000 Received: by pvh1 with SMTP id 1so1826500pvh.31 for ; Fri, 19 Mar 2010 10:52:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=o0bI/ctgv3hOXUkvfBoD+3GAoAKK6NT2Ap30Wl579g8=; b=E3ARTgjuGMrmU4WVXhkHxLBWMYkqbK/kYsXsoHsXjT7uztP2Hv7Xnpz4iojtOzuYun qTUcuwy5iC49F7Zj7KUyzzSU1636YGdhbZzgIIFYLMz67viQZqOgukbvGLFkl2PdEVhd v0np1eUWXVcWEwhPOyu0/nFCqnz6+7QR+tvP4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=RdRRkMNO9eLTrukyhEi9GKdBD1a8EhWv5A20/2jfvt+UjMGJ8zXKUdFEmV6ExiIX3e Jxd6pv7oVdGGlYS04FPYOEd4XqHtUaW9LGX8QWO5B9yi/8rqslrKiL38I9+y8Ku4cOIO 68fXTWEsr3XxlmZCIUQc6sacYNA11nRHgpD7A= MIME-Version: 1.0 Received: by 10.141.22.16 with SMTP id z16mr1949659rvi.139.1269021133439; Fri, 19 Mar 2010 10:52:13 -0700 (PDT) In-Reply-To: <4BA38CD1.6070808@simpletags.org> References: <4BA38CD1.6070808@simpletags.org> Date: Fri, 19 Mar 2010 10:52:13 -0700 Message-ID: <5f7770581003191052w2cd3c765u91ca55b61775e045@mail.gmail.com> Subject: Re: Startup issue when big data in. From: Tatu Saloranta To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org On Fri, Mar 19, 2010 at 7:40 AM, Marcin wrote: > Hi guys, > > is there a way to avoid compacting, flushing and all of this thing on > startup and perform it while node is running ? > > It takes a lot of on startup. One sort of related question: given that order of insertions has huge effects on some stores, like BDB (where inserting in key order is 10x faster than arbitrary order), would insertion order possibly have significant effect on Cassandra as well if using such stores? I bring this up because what we found out when creating local bdbs was that doing disk-sort before inserting big data sets allowed radically faster creation of these (read-only) databases. -+ Tatu +-