accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2749) 1.6.0RC4 slower than 1.5.1
Date Tue, 29 Apr 2014 18:58:16 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984659#comment-13984659
] 

Keith Turner commented on ACCUMULO-2749:
----------------------------------------

It seems a lot of the performance differences I am seeing can be explained by  1.5.1-bin.tar.gz
having a magical native map.   

When I do the following I see slower performance than running w/ the native map included w/
1.5.1-bin.tar.gz.

{noformat}
cd server/src/main/c++/nativeMap/
make clean
make
{noformat}

[~elserj] do you know what version of g++ you used to build 1.5.1 native libs?

My g++ version is the following :
{noformat}
$ g++ -v
Using built-in specs.
Target: x86_64-redhat-linux
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info
--with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix
--enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions
--enable-gnu-unique-object --enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-java-awt=gtk
--disable-dssi --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre --enable-libgcj-multifile
--enable-java-maintainer-mode --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib
--with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 --build=x86_64-redhat-linux
Thread model: posix
gcc version 4.4.7 20120313 (Red Hat 4.4.7-4) (GCC) 
{noformat}


> 1.6.0RC4 slower than 1.5.1
> --------------------------
>
>                 Key: ACCUMULO-2749
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2749
>             Project: Accumulo
>          Issue Type: Bug
>            Reporter: Keith Turner
>            Assignee: Eric Newton
>             Fix For: 1.6.0
>
>         Attachments: ingest_test.diff
>
>
> I am seeing consistently slower write rates when comparing 1.5.1 and 1.6.0 RC4.   Following
env :
>    * hadoop 2.2.0
>    * Zookeeper 3.4.5
>    * Centos 6 (native, not a VM)
>    * using examples/3GB/native-standalone config
>    * setting tserver.mutation.queue.max 4M
>    * I am running test/system/test1/ingest_test.sh
>    * single node
> Saw the following rates
> {noformat}
>   1.5.1 aggregate rate : 200,806 records/sec
>   1.6.0 aggregate rate : 181,264 records/sec (90%)
> {noformat}
> Reran test setting  table.walog.enabled=false
> {noformat}
>   1.5.1 aggregate rate : 302,307 records/sec
>   1.6.0 aggregate rate : 232,685 records/sec (77%)
> {noformat}
> Since the relative performance gap seemed to widen when disabling walog I tried another
test where I disabled walogs and set the devnull iterator 
> {noformat}
>   1.5.1 aggregate rate : 554,853 records/sec
>   1.6.0 aggregate rate : 373,556 records/sec (67%)
> {noformat}
> The relative performance gap grew even further.
> Used the following command to enable dev null iterator in 1.5.1 and RC4
> {noformat}
> config -t test_ingest -s table.iterator.minc.devnull=10,org.apache.accumulo.core.iterators.DevNull
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message