jmeter-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stott, Charlie" <CSt...@tnsi.com>
Subject RE: GUI getting slower?
Date Tue, 09 Apr 2013 06:39:10 GMT
Alternatively, you could re-benchmark after each change to obtain a new baseline and then use
comparative adjustments as required.

You wouldn't really want to be stuck on the same version forever, would you?



> -----Original Message-----
> From: Kostas Papadopoulos [mailto:kostas@methodosit.com.cy]
> Sent: Tuesday, 9 April 2013 4:33 PM
> To: user@jmeter.apache.org
> Cc: Adrian Speteanu
> Subject: Re: GUI getting slower?
> 
> 
> Hi,
> 
> After some more testing, I found this is an issue (at least for me) only when
> throughput is high, of the order of 4000 transactions per sec on 25 threads.
> I don't think it is worth the time to investigate further.
> 
> The lesson for me is that to do comparative performance testing you
> shouldn't change anything from your baseline, including JMeter versions.
> 
> --
> Best Regards
> 
> Kostas Papadopoulos
> 
> K.E MethodosIT Ltd
> 
> Tel: +357 22463610
> Fax: +357 22515197
> Website: http://www.methodosit.com.cy
> 
> 
> On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> > Hi,
> >
> >
> > If you are willing to contribute with tests & results of your own, or
> > if you find a scenario that doesn't work, its safe to say that
> > everyone in the list is interested in reading about it.
> >
> > Cheers.
> >
> >
> >
> >
> >
> > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
> >
> > kostas@methodosit.com.cy> wrote:
> > > Hi Philippe,
> > >
> > > Thanks for the response. We have already changed our test practice
> > > to non-GUI testing so it is not an issue for us. But if anyone needs
> > > to investigate this further I'm willing to help.
> > >
> > > --
> > > Best Regards
> > >
> > > Kostas Papadopoulos
> > >
> > > K.E MethodosIT Ltd
> > >
> > > Tel: +357 22463610
> > > Fax: +357 22515197
> > > Website: http://www.methodosit.com.cy
> > >
> > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > > Hello,
> > > > @Kostas, there is a clear recommandation to do test in NON GUI mode.
> > > > http://jmeter.apache.org/usermanual/best-practices.html
> > > >
> > > > Since 2.5 there has been a lot of fixes on somes GUI issues
> > > > related to synchronization problems, they may have incurred some
> > > > performance degradations although I didn't notice them on the few
> tests I did.
> > > > There has been a Bugzilla opened a while ago and tests didn't show
> > > > it clearly
> > > >
> > > > See:
> > > >    - http://jmeter.apache.org/changes.html
> > > >    - http://jmeter.apache.org/changes_history.html
> > > >
> > > > @Kirk,
> > > > Since 2.5 there has been quite a lot improvements on Memory and
> > > > Performances.
> > > >
> > > > Among this:
> > > >    - fixes on memory leaks
> > > >    - fixes on memory usage by Regexp Extractor which consumed the
> > > >    double of a response size
> > > >    - fixes in core
> > > >
> > > > In 2.9, we introduced a performance improvement that may have
> > > > increased usage of memory which in summary caches the response so
> > > > that it is not converted/parsed as many times as there are post
> > > > processors.
> > > >
> > > > My tests showed an important performance gain if post-processors
> > > > were
> > >
> > > used
> > >
> > > > which in my opinion is the majority of cases.
> > > >
> > > >
> > > > So at first sight I doubt there is performance degradation between
> > > > 2.5
> > >
> > > and
> > >
> > > > 2.9 but I may be wrong.
> > > >
> > > > Don' t hesitate to open an issue with a sample test plan and as
> > > > many informations as you have
> > > >
> > > >
> > > > Regards
> > > >
> > > > Philippe M.
> > > >
> > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > > >
> > > > <kirk.pepperdine@gmail.com>wrote:
> > > > > I've noted some significant differences in performance which
> > > > > I'll be investigating over the next few days. The first thing
> > > > > I've noted is a significant increase in memory requirements.
> > > > >
> > > > > -- Kirk
> > > > >
> > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > > <kostas@methodosit.com.cy>
> > > > >
> > > > > wrote:
> > > > > > We have been using JMeter version 2.5 to do some performance
> > > > > > testing. I recently installed JMeter version 2.9 and I found
> > > > > > that the test results
> > > > >
> > > > > for
> > > > >
> > > > > > the same tests are very different when using the GUI. In one
> > >
> > > instance,
> > >
> > > > > the
> > > > >
> > > > > > same test gives throughput 4500/sec with version 2.5 and
> > > > > > 3800/sec
> > >
> > > with
> > >
> > > > > 2.9.
> > > > >
> > > > > > Running non-gui on both versions gives comparable results
> > > > > > (within
> > >
> > > 2%).
> > >
> > > > > I'm
> > > > >
> > > > > > running these tests on the same exact environment for both
> > > > > > version (same machines, application to be tested, java
> > > > > > version, database, data, etc.)
> > > > > >
> > > > > > Is this to be expected? Is the recommended practise to run
> > > > > > only non-gui?
> > > > >
> > > > > Or
> > > > >
> > > > > > is it something to be looked at more carefully?
> > > > > >
> > > > > > Please excuse me if this has this been addressed before.
> > > > > >
> > > > > > --
> > > > > > Best Regards
> > > > > >
> > > > > > Kostas Papadopoulos
> > > > > >
> > > > > > K.E MethodosIT Ltd
> > > > > >
> > > > > > Tel: +357 22463610
> > > > > > Fax: +357 22515197
> > > > > > Website: http://www.methodosit.com.cy
> > > > > >
> > > > > >
> > > > > > --------------------------------------------------------------
> > > > > > ----
> > > > > > --- To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > > >
> > > > > ----------------------------------------------------------------
> > > > > ----
> > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > >
> > > --------------------------------------------------------------------
> > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > For additional commands, e-mail: user-help@jmeter.apache.org
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org


Mime
View raw message