Return-Path: X-Original-To: apmail-incubator-accumulo-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-accumulo-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 41259797A for ; Fri, 28 Oct 2011 21:57:53 +0000 (UTC) Received: (qmail 41462 invoked by uid 500); 28 Oct 2011 21:57:53 -0000 Delivered-To: apmail-incubator-accumulo-user-archive@incubator.apache.org Received: (qmail 41436 invoked by uid 500); 28 Oct 2011 21:57:53 -0000 Mailing-List: contact accumulo-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: accumulo-user@incubator.apache.org Delivered-To: mailing list accumulo-user@incubator.apache.org Received: (qmail 41428 invoked by uid 99); 28 Oct 2011 21:57:53 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Oct 2011 21:57:53 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jaredwinick@gmail.com designates 209.85.210.41 as permitted sender) Received: from [209.85.210.41] (HELO mail-pz0-f41.google.com) (209.85.210.41) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Oct 2011 21:57:46 +0000 Received: by pzk6 with SMTP id 6so10930514pzk.0 for ; Fri, 28 Oct 2011 14:57:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=vyywKczZ0Flhtc/ELoY5Q+8B40/PKBjHRfb4guD+SUs=; b=vQrayDAOta0X5Q/pTsjoc7ZzfdfSTF44I1T2WED0T/WdyCFg7CWyTdpB0OonO753qo y/rEnLjAgDXRkiZahKwM9lhcNu70MVUOXhALbgFl6gfyMzhNt0DLjkvT1W2dQgOFjx+a mjFP0I4Vgl5PqUFE2bpNtzrzoc1OlsNGcFUJ8= MIME-Version: 1.0 Received: by 10.68.42.6 with SMTP id j6mr6289617pbl.102.1319839046644; Fri, 28 Oct 2011 14:57:26 -0700 (PDT) Received: by 10.143.31.8 with HTTP; Fri, 28 Oct 2011 14:57:26 -0700 (PDT) In-Reply-To: References: Date: Fri, 28 Oct 2011 15:57:26 -0600 Message-ID: Subject: Re: Overloading Tablet Servers From: Jared winick To: accumulo-user@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable > If you are unsure if your iterators are slowing things down, then try > removing them from the table and ingesting. =A0Hopefully you can then > tell wether its the iterators or something else that is causing > problems. > Yeah, the Aggregators I had running seem to be the cause of the very long minor compactions. I think some of my initial confusion has been cleared up from what you guys said and looking at the TabletServerBatchWriter. Unit tests of my Aggregators don't show them to be abnormally slow, but I think I just need to better understand how Accumulo is instantiating and using them internally so I can figure out what is going on. I may also be able to take Eric's suggestion of not running them at minc time but that might cause my queries to slow down too much, so I will have to see. Thanks for the help.