Return-Path: X-Original-To: apmail-accumulo-notifications-archive@minotaur.apache.org Delivered-To: apmail-accumulo-notifications-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 50A7410334 for ; Tue, 29 Apr 2014 01:55:27 +0000 (UTC) Received: (qmail 94996 invoked by uid 500); 29 Apr 2014 01:55:22 -0000 Delivered-To: apmail-accumulo-notifications-archive@accumulo.apache.org Received: (qmail 94938 invoked by uid 500); 29 Apr 2014 01:55:21 -0000 Mailing-List: contact notifications-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: jira@apache.org Delivered-To: mailing list notifications@accumulo.apache.org Received: (qmail 94776 invoked by uid 99); 29 Apr 2014 01:55:17 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Apr 2014 01:55:17 +0000 Date: Tue, 29 Apr 2014 01:55:17 +0000 (UTC) From: "Josh Elser (JIRA)" To: notifications@accumulo.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (ACCUMULO-2749) 1.6.0RC4 slower than 1.5.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/ACCUMULO-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated ACCUMULO-2749: --------------------------------- Attachment: ingest_test.diff Changes to ingest_test.sh to still run the 5 ingest tasks in parallel but wait for them all to finish before existing and grep out the useful records per second metric. > 1.6.0RC4 slower than 1.5.1 > -------------------------- > > Key: ACCUMULO-2749 > URL: https://issues.apache.org/jira/browse/ACCUMULO-2749 > Project: Accumulo > Issue Type: Bug > Affects Versions: 1.6.0 > Reporter: Keith Turner > Fix For: 1.6.1 > > Attachments: ingest_test.diff > > > I am seeing consistently slower write rates when comparing 1.5.1 and 1.6.0 RC4. Following env : > * hadoop 2.2.0 > * Zookeeper 3.4.5 > * Centos 6 (native, not a VM) > * using examples/3GB/native-standalone config > * setting tserver.mutation.queue.max 4M > * I am running test/system/test1/ingest_test.sh > * single node > Saw the following rates > {noformat} > 1.5.1 aggregate rate : 200,806 records/sec > 1.6.0 aggregate rate : 181,264 records/sec (90%) > {noformat} > Reran test setting table.walog.enabled=false > {noformat} > 1.5.1 aggregate rate : 302,307 records/sec > 1.6.0 aggregate rate : 232,685 records/sec (77%) > {noformat} > Since the relative performance gap seemed to widen when disabling walog I tried another test where I disabled walogs and set the devnull iterator > {noformat} > 1.5.1 aggregate rate : 554,853 records/sec > 1.6.0 aggregate rate : 373,556 records/sec (67%) > {noformat} > The relative performance gap grew even further. > Used the following command to enable dev null iterator in 1.5.1 and RC4 > {noformat} > config -t test_ingest -s table.iterator.minc.devnull=10,org.apache.accumulo.core.iterators.DevNull > {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)