jmeter-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dzmitry Kashlach <dzmitrykashl...@gmail.com>
Subject Re: Graphs and reporting in Apache JMeter : Today and Future
Date Sun, 16 Nov 2014 14:11:17 GMT
Hi,

Good idea to deprecate some graph listeners.

Generally, the only listener which I use myself in GUI mode is View Results
Tree, while doing test-plan debugging.

1. May be, it's a good idea to extend Simple Data Writer and attach reports
generation function based on libraries which you've mentioned? But no
graphs in GUI mode.

2. +1. A lot of people are de-facto using JMeter+plugins together. So why
not to include plugins to JMeter, if there are no contradictions?



-------------------------------------------
"Ўчора" ужо было, "заўтра" яшчэ не прыйшло. У нас ёсць
толькі "сёньня".

tel: +375291142462
skype: dmitry.kashlach


On Sun, Nov 16, 2014 at 4:49 PM, Philippe Mouawad <
philippe.mouawad@gmail.com> wrote:

> I created https://issues.apache.org/bugzilla/show_bug.cgi?id=57222 for the
> similarities between Aggregate Report and Summary Report
>
> Regards
> Philippe M.
> @philmdot
>
> On Sun, Nov 16, 2014 at 2:32 PM, Philippe Mouawad <
> philippe.mouawad@gmail.com> wrote:
>
> > Hello,
> > I would like to start a discussion about the future of graphs and
> > reporting in Apache JMeter.
> >
> > Todays state:
> >
> >    - My feeling (I don't want to hurt anybody who worked on those
> >    listeners which are interesting and I am aware that what can be great
> at
> >    some time can become less few years after) is that today:
> >       -  we have the following graphs
> >       - Aggregate Graph : currently affected by bug on
> >          https://issues.apache.org/bugzilla/show_bug.cgi?id=57221 in
> Java
> >          8
> >          - Response Time Graph : interesting but slow to generate and I
> >          get OOM when I try to reload an existing CSV in some
> configuration, I will
> >          report a bug
> >          - Distribution Graph (alpha) : Alpha is not encouraging for
> >          users, is Alpha really needed or is it stable
> >          - Graph Results : Does not look very nice compared with what you
> >          can get today
> >          -  we have the following reports:
> >          - Aggregate Report : Interesting
> >          - Summary Report: Differs from  Aggregate Report by having
> >          additional Avg Bytes and Std Dev but not Median nor 90%Line
> >
> > My opinion and analysis on the current state is the following:
> >
> >    - We lack of clean reporting that would be generated automatically at
> >    end of load test, all the previous graphs need to be generated from
> GUI and
> >    makes you lose some time. Also as we discourage Load Testing from GUI
> we
> >    should propose a way to generate reporting from NON GUI Mode
> >    - Some graphs (Response Time Graph, Aggregate Graph) rely on JCharts
> >    which seems to be abandoned, last release is from 2004 and current bug
> >    57221 may be related to a bug in the library ,by the way this is an
> >    additional argument to get rid of obsolete libraries in JMeter:
> >       - Avalon (Logging + DataSource)
> >       - Excalibur (logging + DataSource)
> >       - jCharts
> >       - Reports are not sufficient and partly redundant , for example it
> >    seems that in terms of information Aggregate report and Summary Report
> >    should be merged. I looked at their code they are really very similar
> , I
> >    think one should be removed and the  infos in both merged
> >
> >
> > I must reckon that today my colleagues and I for example , we all use
> > JMeter-Plugins graphs combined with GraphGeneratorListener, and we are
> very
> > happy with what we get:
> >
> >    -
> >
> http://www.ubik-ingenierie.com/blog/automatically-generating-nice-graphs-at-end-of-your-load-test-with-apache-jmeter-and-jmeter-plugins/
> >
> > I would be interested to know how users generate their reports and graphs
> > currently.
> >
> >
> > But some may object that JMeter-Plugins is not JMeter and conclude that
> > JMeter lacks of an essential feature.
> >
> > So I have 2 propositions to improve JMeter in this field:
> >
> >    - 1/ Create a Brand new Report Generator Listener that would at end of
> >    load test generate a report in HTML or PDF containing:
> >       - Merge of informations contained in current reports
> >       - Generate graphs based on JS Libraries, I am impressed by the
> >       number of libraries that generate nice and sexy graphs:
> >          - http://www.chartjs.org/
> >          - https://github.com/keen/dashboards/tree/gh-pages/examples
> >       - Having them in HTML would allow some dynamice behaviour but the
> >       ideal result would be to be able to export graphs also as images
> >    - 2/ I don't know if it is possible but what about merging
> >    JMeter-Plugins graphing suite + GraphGeneratorListener in JMeter core
> if no
> >    library is in conflict in terms of licensing, of course it would
> required
> >    their agreement :-)
> >
> >
> > I think today any Load Testing tool comes with  reporting feature wether
> > Commercial and Open Source and JMeter as such should improve in this
> field
> > to stay one of the leaders in Load Testing field.
> >
> > Thoughts ?
> >
> > --
> > Regards
> > Philippe M.
> > @philmdot
> >
> >
>
>
> --
> Cordialement.
> Philippe Mouawad.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message