jmeter-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Philippe Mouawad <philippe.moua...@gmail.com>
Subject Re: GUI getting slower?
Date Tue, 09 Apr 2013 06:57:56 GMT
Are you using TransactionController ?

Would it be possible for you to give an overview of your Test Plan using
jmeter_home/extras/schematic.cmd utility ?

Thanks
Regards
Philippe

On Tue, Apr 9, 2013 at 8:52 AM, Kostas Papadopoulos <
kostas@methodosit.com.cy> wrote:

>
> Hi,
>
> > Alternatively, you could re-benchmark after each change to obtain a new
> > baseline and then use comparative adjustments as required.
>
> That's what I meant.
>
> Tests/results can be surprisingly sensitive some times. I also found out
> that
> removing a "Response Assertion" from the test plan got me different
> results.
> Also disabling  a test branch vs setting it to zero loops using a
> -Jparameter
> will give different results.
>
> >
> > You wouldn't really want to be stuck on the same version forever, would
> > you?
> >
> > > -----Original Message-----
> > > From: Kostas Papadopoulos [mailto:kostas@methodosit.com.cy]
> > > Sent: Tuesday, 9 April 2013 4:33 PM
> > > To: user@jmeter.apache.org
> > > Cc: Adrian Speteanu
> > > Subject: Re: GUI getting slower?
> > >
> > >
> > > Hi,
> > >
> > > After some more testing, I found this is an issue (at least for me)
> only
> > > when throughput is high, of the order of 4000 transactions per sec on
> > > 25 threads. I don't think it is worth the time to investigate further.
> > >
> > > The lesson for me is that to do comparative performance testing you
> > > shouldn't change anything from your baseline, including JMeter
> versions.
> > >
> > > --
> > > Best Regards
> > >
> > > Kostas Papadopoulos
> > >
> > > K.E MethodosIT Ltd
> > >
> > > Tel: +357 22463610
> > > Fax: +357 22515197
> > > Website: http://www.methodosit.com.cy
> > >
> > > On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> > > > Hi,
> > > >
> > > >
> > > > If you are willing to contribute with tests & results of your own,
or
> > > > if you find a scenario that doesn't work, its safe to say that
> > > > everyone in the list is interested in reading about it.
> > > >
> > > > Cheers.
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
> > > >
> > > > kostas@methodosit.com.cy> wrote:
> > > > > Hi Philippe,
> > > > >
> > > > > Thanks for the response. We have already changed our test practice
> > > > > to non-GUI testing so it is not an issue for us. But if anyone
> needs
> > > > > to investigate this further I'm willing to help.
> > > > >
> > > > > --
> > > > > Best Regards
> > > > >
> > > > > Kostas Papadopoulos
> > > > >
> > > > > K.E MethodosIT Ltd
> > > > >
> > > > > Tel: +357 22463610
> > > > > Fax: +357 22515197
> > > > > Website: http://www.methodosit.com.cy
> > > > >
> > > > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > > > > Hello,
> > > > > > @Kostas, there is a clear recommandation to do test in NON GUI
> > > > > > mode. http://jmeter.apache.org/usermanual/best-practices.html
> > > > > >
> > > > > > Since 2.5 there has been a lot of fixes on somes GUI issues
> > > > > > related to synchronization problems, they may have incurred
some
> > > > > > performance degradations although I didn't notice them on the
few
> > >
> > > tests I did.
> > >
> > > > > > There has been a Bugzilla opened a while ago and tests didn't
> show
> > > > > > it clearly
> > > > > >
> > > > > > See:
> > > > > >    - http://jmeter.apache.org/changes.html
> > > > > >    - http://jmeter.apache.org/changes_history.html
> > > > > >
> > > > > > @Kirk,
> > > > > > Since 2.5 there has been quite a lot improvements on Memory
and
> > > > > > Performances.
> > > > > >
> > > > > > Among this:
> > > > > >    - fixes on memory leaks
> > > > > >    - fixes on memory usage by Regexp Extractor which consumed
the
> > > > > >    double of a response size
> > > > > >    - fixes in core
> > > > > >
> > > > > > In 2.9, we introduced a performance improvement that may have
> > > > > > increased usage of memory which in summary caches the response
so
> > > > > > that it is not converted/parsed as many times as there are post
> > > > > > processors.
> > > > > >
> > > > > > My tests showed an important performance gain if post-processors
> > > > > > were
> > > > >
> > > > > used
> > > > >
> > > > > > which in my opinion is the majority of cases.
> > > > > >
> > > > > >
> > > > > > So at first sight I doubt there is performance degradation
> between
> > > > > > 2.5
> > > > >
> > > > > and
> > > > >
> > > > > > 2.9 but I may be wrong.
> > > > > >
> > > > > > Don' t hesitate to open an issue with a sample test plan and
as
> > > > > > many informations as you have
> > > > > >
> > > > > >
> > > > > > Regards
> > > > > >
> > > > > > Philippe M.
> > > > > >
> > > > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > > > > >
> > > > > > <kirk.pepperdine@gmail.com>wrote:
> > > > > > > I've noted some significant differences in performance
which
> > > > > > > I'll be investigating over the next few days. The first
thing
> > > > > > > I've noted is a significant increase in memory requirements.
> > > > > > >
> > > > > > > -- Kirk
> > > > > > >
> > > > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > > > > <kostas@methodosit.com.cy>
> > > > > > >
> > > > > > > wrote:
> > > > > > > > We have been using JMeter version 2.5 to do some performance
> > > > > > > > testing. I recently installed JMeter version 2.9 and
I found
> > > > > > > > that the test results
> > > > > > >
> > > > > > > for
> > > > > > >
> > > > > > > > the same tests are very different when using the GUI.
In one
> > > > >
> > > > > instance,
> > > > >
> > > > > > > the
> > > > > > >
> > > > > > > > same test gives throughput 4500/sec with version 2.5
and
> > > > > > > > 3800/sec
> > > > >
> > > > > with
> > > > >
> > > > > > > 2.9.
> > > > > > >
> > > > > > > > Running non-gui on both versions gives comparable
results
> > > > > > > > (within
> > > > >
> > > > > 2%).
> > > > >
> > > > > > > I'm
> > > > > > >
> > > > > > > > running these tests on the same exact environment
for both
> > > > > > > > version (same machines, application to be tested,
java
> > > > > > > > version, database, data, etc.)
> > > > > > > >
> > > > > > > > Is this to be expected? Is the recommended practise
to run
> > > > > > > > only non-gui?
> > > > > > >
> > > > > > > Or
> > > > > > >
> > > > > > > > is it something to be looked at more carefully?
> > > > > > > >
> > > > > > > > Please excuse me if this has this been addressed before.
> > > > > > > >
> > > > > > > > --
> > > > > > > > Best Regards
> > > > > > > >
> > > > > > > > Kostas Papadopoulos
> > > > > > > >
> > > > > > > > K.E MethodosIT Ltd
> > > > > > > >
> > > > > > > > Tel: +357 22463610
> > > > > > > > Fax: +357 22515197
> > > > > > > > Website: http://www.methodosit.com.cy
> > > > > > > >
> > > > > > > >
> > > > > > > >
> --------------------------------------------------------------
> > > > > > > > ----
> > > > > > > > --- To unsubscribe, e-mail:
> user-unsubscribe@jmeter.apache.org
> > > > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > > > > >
> > > > > > >
> ----------------------------------------------------------------
> > > > > > > ----
> > > > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > > >
> > > > >
> --------------------------------------------------------------------
> > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > For additional commands, e-mail: user-help@jmeter.apache.org
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
>
>


-- 
Cordialement.
Philippe Mouawad.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message