Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 179929F33 for ; Sun, 29 Apr 2012 16:49:34 +0000 (UTC) Received: (qmail 95666 invoked by uid 500); 29 Apr 2012 16:49:31 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 95648 invoked by uid 500); 29 Apr 2012 16:49:31 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 95640 invoked by uid 99); 29 Apr 2012 16:49:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 29 Apr 2012 16:49:31 +0000 X-ASF-Spam-Status: No, hits=0.6 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of benoit@noisette.ch designates 209.85.214.172 as permitted sender) Received: from [209.85.214.172] (HELO mail-ob0-f172.google.com) (209.85.214.172) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 29 Apr 2012 16:49:26 +0000 Received: by obbtb4 with SMTP id tb4so3600046obb.31 for ; Sun, 29 Apr 2012 09:49:04 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding:x-gm-message-state; bh=mA2g55oMQEYVVrwEsjrIsTs2Q86R02VkMkNi3vbSFSM=; b=fWbJDxdsxY/RNelKmaowAJscP883CGUI9HtuJIo4ipFdBn9sjCcXblKulD9X9sPypP 3Mokb7nF/8b3BN6/X22rknVuEKjDFgECis6XJxAGBeGVv1Zw6k6s16AOBBSh04MHak8W Up3lE3UVN6Fl3uoB8md89MkHUO/2b1jWJP7CLoiebSqKDUOzgNG158xRL9L9+s/cUFHT MPTRfj8e8uowOsYsF8ib17oT06qiTlcUjGmTEJOHf0/c5K/nm8Sa1kYcmSSrfH0pHRJs JL5Z96HOyExubnUHbOYQVT29FIHTX/bp878Io4MTnGvAjo7sXRLRn+LuCdNNGWdf//94 mv5Q== MIME-Version: 1.0 Received: by 10.60.14.136 with SMTP id p8mr23612948oec.68.1335718144492; Sun, 29 Apr 2012 09:49:04 -0700 (PDT) Received: by 10.182.185.101 with HTTP; Sun, 29 Apr 2012 09:49:04 -0700 (PDT) In-Reply-To: <1335571187223-7507756.post@n2.nabble.com> References: <1335571187223-7507756.post@n2.nabble.com> Date: Sun, 29 Apr 2012 18:49:04 +0200 Message-ID: Subject: Re: Building SSTables with SSTableSimpleUnsortedWriter From: Benoit Perroud To: user@cassandra.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Gm-Message-State: ALoCoQke+vv82gJscFdHFFjRzlXUYr2G5p/TfDDBDBaLsNsKb2FLCthZuP+KuYDFoL55BkjNcj3c X-Virus-Checked: Checked by ClamAV on apache.org big buffer size will use more Heap memory at creation of the tables. Not sure impact on server side, but shouldn't be a big difference. I personally use 512Mb. 2012/4/28 sj.climber : > Can anyone comment on best practices for setting the buffer size used by > SSTableSimpleUnsortedWriter? =C2=A0I'm presently using 100MB, but for som= e of the > larger column families I'm working with, this can result in hundreds of > SSTables. =C2=A0After streaming to Cassandra via sstableloader, there's a= fair > amount of compaction work to do. > > What are the benefits and consequences of going with a higher buffer size= ? > > Thanks! > > -- > View this message in context: http://cassandra-user-incubator-apache-org.= 3065146.n2.nabble.com/Building-SSTables-with-SSTableSimpleUnsortedWriter-tp= 7507756.html > Sent from the cassandra-user@incubator.apache.org mailing list archive at= Nabble.com. --=20 sent from my Nokia 3210