Return-Path: X-Original-To: apmail-cassandra-dev-archive@www.apache.org Delivered-To: apmail-cassandra-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3C5A9E0B0 for ; Fri, 22 Feb 2013 12:04:43 +0000 (UTC) Received: (qmail 66535 invoked by uid 500); 22 Feb 2013 12:04:42 -0000 Delivered-To: apmail-cassandra-dev-archive@cassandra.apache.org Received: (qmail 66160 invoked by uid 500); 22 Feb 2013 12:04:37 -0000 Mailing-List: contact dev-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list dev@cassandra.apache.org Received: (qmail 66126 invoked by uid 99); 22 Feb 2013 12:04:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Feb 2013 12:04:35 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests= X-Spam-Check-By: apache.org Received-SPF: unknown -allip4:64.6.108.239 (athena.apache.org: encountered unrecognized mechanism during SPF processing of domain of hsn@filez.com) Received: from [64.6.108.239] (HELO ponto.amerinoc.com) (64.6.108.239) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Feb 2013 12:04:27 +0000 Received: from fbsd9.localdomain (205.83.broadband7.iol.cz [88.102.83.205]) (authenticated bits=128) by ponto.amerinoc.com (8.14.5/8.14.5) with ESMTP id r1MC3w7X049022 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Fri, 22 Feb 2013 13:04:06 +0100 (CET) (envelope-from hsn@filez.com) Received: from [127.0.0.1] ([10.0.0.1]) by fbsd9.localdomain (8.14.5/8.14.5) with ESMTP id r1MC3qCc001160 for ; Fri, 22 Feb 2013 13:03:53 +0100 (CET) (envelope-from hsn@filez.com) Message-ID: <51275DC7.8060302@filez.com> Date: Fri, 22 Feb 2013 13:00:07 +0100 From: Radim Kolar User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:17.0) Gecko/20130215 Thunderbird/17.0.3 MIME-Version: 1.0 To: dev@cassandra.apache.org Subject: Re: real leveldb vs cassandra leveldb References: <51193E1D.3080902@filez.com> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Antivirus: avast! (VPS 130222-0, 22.02.2013), Outbound message X-Antivirus-Status: Clean X-Virus-Checked: Checked by ClamAV on apache.org Dne 13.2.2013 16:32, Jonathan Ellis napsal(a): > The only point here that would make a difference in practice is > leveldb using a worse hash function. how do you know that it would not make difference in practice. i have implemented some optimalization from leveldb to cassandra - different L0 level - 12 tables of 1/10 size L1, faster promotion to next level and variable number of sstables per level and it performs faster for write heavy workload. i do not understand why you are not interested in performance optimalizations. For example yesterday i did buffered sstable writing and it turned to be significant perfomance advantage using 1mb buffer changed test time from 1m50s to 0m40s. Another significant gain is to use read ahead in compactions and replace bucket based size tiered compaction to compaction strategy used in lucene - it did not produce immortal sstables like cassandra does. i have quite high demands for perfomance, my test environment for new project has about 1 bilion new rows per day, in production it will be about 30 times higher, so what is worth coding for me might not be worth coding for you.