Return-Path: X-Original-To: apmail-incubator-accumulo-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-accumulo-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 429FD9A5C for ; Thu, 15 Mar 2012 18:14:40 +0000 (UTC) Received: (qmail 44995 invoked by uid 500); 15 Mar 2012 18:14:40 -0000 Delivered-To: apmail-incubator-accumulo-user-archive@incubator.apache.org Received: (qmail 44950 invoked by uid 500); 15 Mar 2012 18:14:40 -0000 Mailing-List: contact accumulo-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: accumulo-user@incubator.apache.org Delivered-To: mailing list accumulo-user@incubator.apache.org Received: (qmail 44940 invoked by uid 99); 15 Mar 2012 18:14:40 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Mar 2012 18:14:40 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of eric.newton@gmail.com designates 209.85.210.175 as permitted sender) Received: from [209.85.210.175] (HELO mail-iy0-f175.google.com) (209.85.210.175) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 15 Mar 2012 18:14:35 +0000 Received: by iaag37 with SMTP id g37so3992788iaa.6 for ; Thu, 15 Mar 2012 11:14:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=mQHcuGnzVNivqefMjHxaoNF71QB3+Sjc3q3h1rCuqMM=; b=ZBbjzKzBytZKWa6+J7nnjAi8gCUPuJMTQaHyxhgMy+IA0iwPKZLwujTmINEmPkLEpr ZiEmThSE2qHwCVV1cdIRrXmDNrEWuwFpsuYVbz0YuPOl3wj3Kw11F2AihMN9E849ZIma fdcZzrtt4ouiCVrHMpfoKhBv3dUulwKfqd+ar7c1tSLhBu3nu58Pxk0trjBV7kPnx4Vs sT1STgOg9IneJJ/EScSD2205Z8g067b3JzYLhICOKGmxc9jB5x31a0ojSVpNrTt6x93d QsJQk8QBvt5gUdOQ4lYEg6iMOMBO81s5EOL1xEycTeSbdscT4Kr/d6BFCedDI3+Y+buN 1yfw== MIME-Version: 1.0 Received: by 10.50.222.233 with SMTP id qp9mr10488979igc.58.1331835254685; Thu, 15 Mar 2012 11:14:14 -0700 (PDT) Received: by 10.50.181.202 with HTTP; Thu, 15 Mar 2012 11:14:14 -0700 (PDT) In-Reply-To: References: <994345186.210224.1331728761047.JavaMail.root@linzimmb04o.imo.intelink.gov> <1060386868.210310.1331729709506.JavaMail.root@linzimmb04o.imo.intelink.gov> <093EAB93-A0B7-44BC-B43B-CD372569A4BF@cordovas.org> Date: Thu, 15 Mar 2012 14:14:14 -0400 Message-ID: Subject: Re: conf/examples From: Eric Newton To: accumulo-user@incubator.apache.org Content-Type: multipart/alternative; boundary=14dae93406d74140e304bb4c0f9a X-Virus-Checked: Checked by ClamAV on apache.org --14dae93406d74140e304bb4c0f9a Content-Type: text/plain; charset=ISO-8859-1 My little test is ingesting 2M key/value pairs, which should be bigger than memory on all 4 configurations. After that, I restart all the processes and verify the data. A smaller log file size would make recoveries run faster. -Eric On Thu, Mar 15, 2012 at 9:30 AM, Keith Turner wrote: > Should tserver.walog.max.size also be adjusted down so that log sort > does not produce as many files? The sort buffer size was cut by a > factor of 4, could adjust the max size by the same. > > On Thu, Mar 15, 2012 at 9:20 AM, Eric Newton > wrote: > > I've written a script to test all the configs. I wasn't loading enough > data > > in test it properly before. > > > > Looks like the 512MB and 1G configs need: > > > > > > logger.sort.buffer.size > > 50M > > > > > > > > -Eric > > > > > > On Wed, Mar 14, 2012 at 9:53 AM, David Medinets < > david.medinets@gmail.com> > > wrote: > >> > >> I'll test the 1GB on my laptop if the example files make it back into > >> the tar.gz file. > > > > > --14dae93406d74140e304bb4c0f9a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable My little test is ingesting 2M key/value pairs, which should be bigger than= memory on all 4 configurations. =A0After that, I restart all the processes= and verify the data.

A smaller log file size would make= recoveries run faster.

-Eric

On Thu, = Mar 15, 2012 at 9:30 AM, Keith Turner <keith@deenlo.com> wrot= e:
Should tserver.walog.max.size also be adjusted down so that log sort
does not produce as many files? =A0The sort buffer size was cut by a
factor of 4, could adjust the max size by the same.

On Thu, Mar 15, 2012 at 9:20 AM, Eric Newton <eric.newton@gmail.com> wrote:
> I've written a script to test all the configs. =A0I wasn't loa= ding enough data
> in test it properly before.
>
> Looks like the 512MB and 1G configs need:
>
> =A0 =A0 <property>
> =A0 =A0 =A0 <name>logger.sort.buffer.size</name>
> =A0 =A0 =A0 <value>50M</value>
> =A0 =A0 </property>
>
>
> -Eric
>
>
> On Wed, Mar 14, 2012 at 9:53 AM, David Medinets <david.medinets@gmail.com>= ;
> wrote:
>>
>> I'll test the 1GB on my laptop if the example files make it ba= ck into
>> the tar.gz file.
>
>

--14dae93406d74140e304bb4c0f9a--