accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2749) 1.6.0RC4 slower than 1.5.1
Date Tue, 29 Apr 2014 19:06:16 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984666#comment-13984666
] 

Josh Elser commented on ACCUMULO-2749:
--------------------------------------

[~kturner], you just made me day with that one. Magical native maps will now have a special
place in my memory. Looking at my package manager history, I don't think I've upgraded since
making 1.5.1.

{noformat}
$ g++ -v
Using built-in specs.
COLLECT_GCC=/usr/x86_64-pc-linux-gnu/gcc-bin/4.7.3/g++
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-pc-linux-gnu/4.7.3/lto-wrapper
Target: x86_64-pc-linux-gnu
Configured with: /var/tmp/portage/sys-devel/gcc-4.7.3-r1/work/gcc-4.7.3/configure --host=x86_64-pc-linux-gnu
--build=x86_64-pc-linux-gnu --prefix=/usr --bindir=/usr/x86_64-pc-linux-gnu/gcc-bin/4.7.3
--includedir=/usr/lib/gcc/x86_64-pc-linux-gnu/4.7.3/include --datadir=/usr/share/gcc-data/x86_64-pc-linux-gnu/4.7.3
--mandir=/usr/share/gcc-data/x86_64-pc-linux-gnu/4.7.3/man --infodir=/usr/share/gcc-data/x86_64-pc-linux-gnu/4.7.3/info
--with-gxx-include-dir=/usr/lib/gcc/x86_64-pc-linux-gnu/4.7.3/include/g++-v4 --with-python-dir=/share/gcc-data/x86_64-pc-linux-gnu/4.7.3/python
--enable-languages=c,c++,objc,fortran --enable-obsolete --enable-secureplt --disable-werror
--with-system-zlib --enable-nls --without-included-gettext --enable-checking=release --with-bugurl=https://bugs.gentoo.org/
--with-pkgversion='Gentoo 4.7.3-r1 p1.4, pie-0.5.5' --enable-libstdcxx-time --enable-shared
--enable-threads=posix --enable-__cxa_atexit --enable-clocale=gnu --enable-multilib --with-multilib-list=m32,m64
--disable-altivec --disable-fixed-point --enable-targets=all --disable-libgcj --enable-libgomp
--disable-libmudflap --disable-libssp --enable-lto --without-cloog --without-ppl
Thread model: posix
gcc version 4.7.3 (Gentoo 4.7.3-r1 p1.4, pie-0.5.5)
{noformat}

> 1.6.0RC4 slower than 1.5.1
> --------------------------
>
>                 Key: ACCUMULO-2749
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2749
>             Project: Accumulo
>          Issue Type: Bug
>            Reporter: Keith Turner
>            Assignee: Eric Newton
>             Fix For: 1.6.0
>
>         Attachments: ingest_test.diff
>
>
> I am seeing consistently slower write rates when comparing 1.5.1 and 1.6.0 RC4.   Following
env :
>    * hadoop 2.2.0
>    * Zookeeper 3.4.5
>    * Centos 6 (native, not a VM)
>    * using examples/3GB/native-standalone config
>    * setting tserver.mutation.queue.max 4M
>    * I am running test/system/test1/ingest_test.sh
>    * single node
> Saw the following rates
> {noformat}
>   1.5.1 aggregate rate : 200,806 records/sec
>   1.6.0 aggregate rate : 181,264 records/sec (90%)
> {noformat}
> Reran test setting  table.walog.enabled=false
> {noformat}
>   1.5.1 aggregate rate : 302,307 records/sec
>   1.6.0 aggregate rate : 232,685 records/sec (77%)
> {noformat}
> Since the relative performance gap seemed to widen when disabling walog I tried another
test where I disabled walogs and set the devnull iterator 
> {noformat}
>   1.5.1 aggregate rate : 554,853 records/sec
>   1.6.0 aggregate rate : 373,556 records/sec (67%)
> {noformat}
> The relative performance gap grew even further.
> Used the following command to enable dev null iterator in 1.5.1 and RC4
> {noformat}
> config -t test_ingest -s table.iterator.minc.devnull=10,org.apache.accumulo.core.iterators.DevNull
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message