jmeter-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kostas Papadopoulos <kos...@methodosit.com.cy>
Subject Re: GUI getting slower?
Date Tue, 09 Apr 2013 07:53:51 GMT

See attached. Don't have a Windows machine available but run the ant script 
in schematic.cmd  directly, hope it came out OK.

-- 
Best Regards

Kostas Papadopoulos

K.E MethodosIT Ltd

Tel: +357 22463610
Fax: +357 22515197
Website: http://www.methodosit.com.cy


On Tue 09 Apr 2013 09:57:56 Philippe Mouawad wrote:
> Are you using TransactionController ?
> 
> Would it be possible for you to give an overview of your Test Plan using
> jmeter_home/extras/schematic.cmd utility ?
> 
> Thanks
> Regards
> Philippe
> 
> On Tue, Apr 9, 2013 at 8:52 AM, Kostas Papadopoulos <
> 
> kostas@methodosit.com.cy> wrote:
> > Hi,
> > 
> > > Alternatively, you could re-benchmark after each change to obtain a
> > > new baseline and then use comparative adjustments as required.
> > 
> > That's what I meant.
> > 
> > Tests/results can be surprisingly sensitive some times. I also found out
> > that
> > removing a "Response Assertion" from the test plan got me different
> > results.
> > Also disabling  a test branch vs setting it to zero loops using a
> > -Jparameter
> > will give different results.
> > 
> > > You wouldn't really want to be stuck on the same version forever,
> > > would you?
> > > 
> > > > -----Original Message-----
> > > > From: Kostas Papadopoulos [mailto:kostas@methodosit.com.cy]
> > > > Sent: Tuesday, 9 April 2013 4:33 PM
> > > > To: user@jmeter.apache.org
> > > > Cc: Adrian Speteanu
> > > > Subject: Re: GUI getting slower?
> > > > 
> > > > 
> > > > Hi,
> > > > 
> > > > After some more testing, I found this is an issue (at least for me)
> > 
> > only
> > 
> > > > when throughput is high, of the order of 4000 transactions per sec
> > > > on 25 threads. I don't think it is worth the time to investigate
> > > > further.
> > > > 
> > > > The lesson for me is that to do comparative performance testing you
> > > > shouldn't change anything from your baseline, including JMeter
> > 
> > versions.
> > 
> > > > --
> > > > Best Regards
> > > > 
> > > > Kostas Papadopoulos
> > > > 
> > > > K.E MethodosIT Ltd
> > > > 
> > > > Tel: +357 22463610
> > > > Fax: +357 22515197
> > > > Website: http://www.methodosit.com.cy
> > > > 
> > > > On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> > > > > Hi,
> > > > > 
> > > > > 
> > > > > If you are willing to contribute with tests & results of your
own,
> > > > > or if you find a scenario that doesn't work, its safe to say that
> > > > > everyone in the list is interested in reading about it.
> > > > > 
> > > > > Cheers.
> > > > > 
> > > > > 
> > > > > 
> > > > > 
> > > > > 
> > > > > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
> > > > > 
> > > > > kostas@methodosit.com.cy> wrote:
> > > > > > Hi Philippe,
> > > > > > 
> > > > > > Thanks for the response. We have already changed our test
> > > > > > practice to non-GUI testing so it is not an issue for us. But
> > > > > > if anyone
> > 
> > needs
> > 
> > > > > > to investigate this further I'm willing to help.
> > > > > > 
> > > > > > --
> > > > > > Best Regards
> > > > > > 
> > > > > > Kostas Papadopoulos
> > > > > > 
> > > > > > K.E MethodosIT Ltd
> > > > > > 
> > > > > > Tel: +357 22463610
> > > > > > Fax: +357 22515197
> > > > > > Website: http://www.methodosit.com.cy
> > > > > > 
> > > > > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > > > > > Hello,
> > > > > > > @Kostas, there is a clear recommandation to do test in
NON GUI
> > > > > > > mode. http://jmeter.apache.org/usermanual/best-practices.html
> > > > > > > 
> > > > > > > Since 2.5 there has been a lot of fixes on somes GUI issues
> > > > > > > related to synchronization problems, they may have incurred
> > > > > > > some performance degradations although I didn't notice
them
> > > > > > > on the few
> > > > 
> > > > tests I did.
> > > > 
> > > > > > > There has been a Bugzilla opened a while ago and tests
didn't
> > 
> > show
> > 
> > > > > > > it clearly
> > > > > > > 
> > > > > > > See:
> > > > > > >    - http://jmeter.apache.org/changes.html
> > > > > > >    - http://jmeter.apache.org/changes_history.html
> > > > > > > 
> > > > > > > @Kirk,
> > > > > > > Since 2.5 there has been quite a lot improvements on Memory
> > > > > > > and Performances.
> > > > > > > 
> > > > > > > Among this:
> > > > > > >    - fixes on memory leaks
> > > > > > >    - fixes on memory usage by Regexp Extractor which consumed
> > > > > > >    the double of a response size
> > > > > > >    - fixes in core
> > > > > > > 
> > > > > > > In 2.9, we introduced a performance improvement that may
have
> > > > > > > increased usage of memory which in summary caches the response
> > > > > > > so that it is not converted/parsed as many times as there
are
> > > > > > > post processors.
> > > > > > > 
> > > > > > > My tests showed an important performance gain if
> > > > > > > post-processors were
> > > > > > 
> > > > > > used
> > > > > > 
> > > > > > > which in my opinion is the majority of cases.
> > > > > > > 
> > > > > > > 
> > > > > > > So at first sight I doubt there is performance degradation
> > 
> > between
> > 
> > > > > > > 2.5
> > > > > > 
> > > > > > and
> > > > > > 
> > > > > > > 2.9 but I may be wrong.
> > > > > > > 
> > > > > > > Don' t hesitate to open an issue with a sample test plan
and
> > > > > > > as many informations as you have
> > > > > > > 
> > > > > > > 
> > > > > > > Regards
> > > > > > > 
> > > > > > > Philippe M.
> > > > > > > 
> > > > > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > > > > > > 
> > > > > > > <kirk.pepperdine@gmail.com>wrote:
> > > > > > > > I've noted some significant differences in performance
which
> > > > > > > > I'll be investigating over the next few days. The
first
> > > > > > > > thing I've noted is a significant increase in memory
> > > > > > > > requirements.
> > > > > > > > 
> > > > > > > > -- Kirk
> > > > > > > > 
> > > > > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > > > > > <kostas@methodosit.com.cy>
> > > > > > > > 
> > > > > > > > wrote:
> > > > > > > > > We have been using JMeter version 2.5 to do some
> > > > > > > > > performance testing. I recently installed JMeter
version
> > > > > > > > > 2.9 and I found that the test results
> > > > > > > > 
> > > > > > > > for
> > > > > > > > 
> > > > > > > > > the same tests are very different when using
the GUI. In
> > > > > > > > > one
> > > > > > 
> > > > > > instance,
> > > > > > 
> > > > > > > > the
> > > > > > > > 
> > > > > > > > > same test gives throughput 4500/sec with version
2.5 and
> > > > > > > > > 3800/sec
> > > > > > 
> > > > > > with
> > > > > > 
> > > > > > > > 2.9.
> > > > > > > > 
> > > > > > > > > Running non-gui on both versions gives comparable
results
> > > > > > > > > (within
> > > > > > 
> > > > > > 2%).
> > > > > > 
> > > > > > > > I'm
> > > > > > > > 
> > > > > > > > > running these tests on the same exact environment
for both
> > > > > > > > > version (same machines, application to be tested,
java
> > > > > > > > > version, database, data, etc.)
> > > > > > > > > 
> > > > > > > > > Is this to be expected? Is the recommended practise
to run
> > > > > > > > > only non-gui?
> > > > > > > > 
> > > > > > > > Or
> > > > > > > > 
> > > > > > > > > is it something to be looked at more carefully?
> > > > > > > > > 
> > > > > > > > > Please excuse me if this has this been addressed
before.
> > > > > > > > > 
> > > > > > > > > --
> > > > > > > > > Best Regards
> > > > > > > > > 
> > > > > > > > > Kostas Papadopoulos
> > > > > > > > > 
> > > > > > > > > K.E MethodosIT Ltd
> > > > > > > > > 
> > > > > > > > > Tel: +357 22463610
> > > > > > > > > Fax: +357 22515197
> > > > > > > > > Website: http://www.methodosit.com.cy
> > 
> > --------------------------------------------------------------
> > 
> > > > > > > > > ----
> > 
> > > > > > > > > --- To unsubscribe, e-mail:
> > user-unsubscribe@jmeter.apache.org
> > 
> > > > > > > > > For additional commands, e-mail:
> > > > > > > > > user-help@jmeter.apache.org
> > 
> > ----------------------------------------------------------------
> > 
> > > > > > > > ----
> > > > > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > 
> > --------------------------------------------------------------------
> > 
> > > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > > 
> > > > --------------------------------------------------------------------
> > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > 
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > For additional commands, e-mail: user-help@jmeter.apache.org
> > 
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org


Mime
View raw message