Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@accumulo.apache.org
Received-SPF: error (nike.apache.org: local policy)
MIME-Version: 1.0
In-Reply-To: 
 <0A8F66C42F49E448A40E99946404EE5B768399BE07@aplesstar.dom1.jhuapl.edu>
References: 
 <0A8F66C42F49E448A40E99946404EE5B768399BE07@aplesstar.dom1.jhuapl.edu>
Date: Wed, 26 Jun 2013 08:09:00 -0400
Message-ID: 
 <CAGUtCHon1i+U=tbkhZw9PTBd=qPOAGBKXn-fggdrP1BdPSwD_A@mail.gmail.com>
Subject: Re: Minor compaction occurring often with fairly long delays during
 ingest.
From: Keith Turner <keith@deenlo.com>
To: user@accumulo.apache.org
Content-Type: multipart/alternative; boundary=089e013a0696c6b61604e00d82e4

--089e013a0696c6b61604e00d82e4
Content-Type: text/plain; charset=ISO-8859-1

Its possible that you could be running into ACCUMULO-1062 [1], although I
am thinking your large values may be at issue.  Erics suggestion of having
more tablets can help work around this issue, in addition to allowing more
minc parallelism.

[1] : https://issues.apache.org/jira/browse/ACCUMULO-1062


On Tue, Jun 25, 2013 at 7:06 PM, Hider, Sandy <Sandy.Hider@jhuapl.edu>wrote:

> I recently setup Accumulo 1.4.2 on a rack of boxes that each has 24
> processors and 43 GB of RAM.  I set them up using the 3GB example templates
> but then increased the max size of the Tserver and a few other components
> to 5GB.
>
> Doing some initial tests importing roughly 7000 records, each record has
> approximately 7 small fields and 1 large field holding data between 200Kb
> to 1Mb in size.  While ingesting I am seeing the server hold and start
> minor compactions which seem to take quite a while after 2000-3000 records,
> and then occurring again fairly frequently
>
> I am wondering what options I have to try and minimize the frequency of
> minor compactions during ingest.    What components memory sizes and config
> properties would help me avoid this problem?  If anyone has other ideas for
> me to try and fix this please let me know.
>
> Thanks in advance,
>
> Sandy
>
>
>
>

--089e013a0696c6b61604e00d82e4
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div style>Its possible that you could be running into ACC=
UMULO-1062 [1], although I am thinking your large values may be at issue. =
=A0Erics suggestion of having more tablets can help work around this issue,=
 in addition to allowing more minc parallelism.</div>
<div><br></div>[1] :=A0<a href=3D"https://issues.apache.org/jira/browse/ACC=
UMULO-1062">https://issues.apache.org/jira/browse/ACCUMULO-1062</a><br></di=
v><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">On Tue, Jun=
 25, 2013 at 7:06 PM, Hider, Sandy <span dir=3D"ltr">&lt;<a href=3D"mailto:=
Sandy.Hider@jhuapl.edu" target=3D"_blank">Sandy.Hider@jhuapl.edu</a>&gt;</s=
pan> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">I recently setup Accumulo 1.4.2 on a rack of=
 boxes that each has 24 processors and 43 GB of RAM. =A0I set them up using=
 the 3GB example templates but then increased the max size of the Tserver a=
nd a few other components to 5GB.<br>

<br>
Doing some initial tests importing roughly 7000 records, each record has ap=
proximately 7 small fields and 1 large field holding data between 200Kb to =
1Mb in size. =A0While ingesting I am seeing the server hold and start minor=
 compactions which seem to take quite a while after 2000-3000 records, and =
then occurring again fairly frequently<br>

<br>
I am wondering what options I have to try and minimize the frequency of min=
or compactions during ingest. =A0 =A0What components memory sizes and confi=
g properties would help me avoid this problem? =A0If anyone has other ideas=
 for me to try and fix this please let me know.<br>

<br>
Thanks in advance,<br>
<br>
Sandy<br>
<br>
<br>
<br>
</blockquote></div><br></div>

--089e013a0696c6b61604e00d82e4--