Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3B734109E3 for ; Mon, 28 Oct 2013 22:28:23 +0000 (UTC) Received: (qmail 29668 invoked by uid 500); 28 Oct 2013 22:28:23 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 29633 invoked by uid 500); 28 Oct 2013 22:28:23 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 29625 invoked by uid 99); 28 Oct 2013 22:28:23 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Oct 2013 22:28:23 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of texpilot@gmail.com designates 74.125.83.46 as permitted sender) Received: from [74.125.83.46] (HELO mail-ee0-f46.google.com) (74.125.83.46) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Oct 2013 22:28:18 +0000 Received: by mail-ee0-f46.google.com with SMTP id c1so3778137eek.33 for ; Mon, 28 Oct 2013 15:27:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=2Dij+z6eMLEKc1+RkMZqV4QXLKPb4E4rfSc4QL01v5w=; b=LLqNxHiwO5Xgm/ifADVAs4OQKA+9dwC3Rm8hAUd9sB0Qh4N9Iz9Q+7Hem8cz0oKGNN GLBNKNt1BhfDD2wLigRTLE76Xc9j6jHdVB8olrKUgrTzECReRQpiI0ErhSO56r5HX5Y8 dnexaVV3gvFXptbNJYYrJTHLv4Am0dt+uyTgdj+TtCDnBm02OYhdnten8iMFwBMBPvah Kfj1DWKpSX91ynpsx0kaZnST1digKXYvKJRLpCKWzgWBkRX5FbsMU8fo6tFrAQzuUmKr lgRyU7aMpx2eQR2sB/ChlHh5W76VNQyAFZJAkuhKB+UUIi/vOlg1PpRRtykR7MyKRm3q 04RA== MIME-Version: 1.0 X-Received: by 10.14.183.130 with SMTP id q2mr4658149eem.64.1382999277565; Mon, 28 Oct 2013 15:27:57 -0700 (PDT) Received: by 10.223.87.74 with HTTP; Mon, 28 Oct 2013 15:27:57 -0700 (PDT) In-Reply-To: References: Date: Mon, 28 Oct 2013 17:27:57 -0500 Message-ID: Subject: Re: How to reduce number of entries in memory From: "Terry P." To: "user@accumulo.apache.org" Content-Type: multipart/alternative; boundary=047d7b34429ea9feff04e9d49c53 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b34429ea9feff04e9d49c53 Content-Type: text/plain; charset=UTF-8 The developers are flushing their BatchWriter. On Mon, Oct 28, 2013 at 5:23 PM, Keith Turner wrote: > > > > On Mon, Oct 28, 2013 at 5:19 PM, Terry P. wrote: > >> Greetings all, >> For a growing table that currently from zero to 70 million entries this >> weekend, I'm seeing 4.4 million entries still in memory, though the client >> programs are supposed to be flushing their entries. >> > > Are you flushing the batch writer or the table? > > >> >> Is there a server-side setting to help reduce the number of entries that >> are in memory (not yet flushed to disk)? Our system has fairly light >> performance requirements, so I'm okay if a tweak may result in reduced >> ingest performance. >> >> Thanks in advance, >> Terry >> > > --047d7b34429ea9feff04e9d49c53 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
The developers are flushing their BatchWriter.


On Mon, Oct 28,= 2013 at 5:23 PM, Keith Turner <keith@deenlo.com> wrote:



On Mon, Oct 28, 20= 13 at 5:19 PM, Terry P. <texpilot@gmail.com> wrote:
Greetings all,
For a growing table that currently from zero= to 70 million entries this weekend, I'm seeing 4.4 million entries sti= ll in memory, though the client programs are supposed to be flushing their = entries.

Are you flushing the bat= ch writer or the table?
=C2=A0

Is there a server-side setting to help reduce the number of = entries that are in memory (not yet flushed to disk)?=C2=A0 Our system has = fairly light performance requirements, so I'm okay if a tweak may resul= t in reduced ingest performance.

Thanks in advance,
Terry


--047d7b34429ea9feff04e9d49c53--