jmeter-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Philippe Mouawad <philippe.moua...@gmail.com>
Subject Re: APDEX Computing and reporting
Date Sun, 01 Feb 2015 19:41:19 GMT
Links:

https://issues.apache.org/bugzilla/attachment.cgi?id=32420

https://issues.apache.org/bugzilla/show_bug.cgi?id=57516

Regards

On Sunday, February 1, 2015, Philippe Mouawad <philippe.mouawad@gmail.com>
wrote:

> Hi ,
> I uploaded a screenshot and new patch code showing what I meant.
> I think including it in core should be considered seriously.
> @Felix thanks for review of initial patch.
> Regards
>
> On Sunday, February 1, 2015, sebb <sebbaz@gmail.com
> <javascript:_e(%7B%7D,'cvml','sebbaz@gmail.com');>> wrote:
>
>> On 31 January 2015 at 13:16, Philippe Mouawad
>> <philippe.mouawad@gmail.com> wrote:
>> > On Sat, Jan 31, 2015 at 12:30 PM, Felix Schumacher <
>> > felix.schumacher@internetallee.de> wrote:
>> >
>> >> Am 30.01.2015 um 13:31 schrieb Philippe Mouawad:
>> >>
>> >>> Hi,
>> >>> I intend to commit a BackendListener client implementation that
>> computes
>> >>> APDEX at end of Load Test.
>> >>> It will take:
>> >>>
>> >>>     - Acceptable Response Time (http://www.apdex.fr/) T
>> >>>
>> >> The link was in french (my french is not very good (really non existant
>> >> :)), but luckily wikipedia had an article about apdex, which I could
>> read.
>> >>
>> >
>> > Sorry for the french link some references:
>> > http://www.apdex.org/overview.html
>> >
>> >      - Compute F as 4xT but allow customization
>> >>>     - List of samples taken into account
>> >>>
>> >>>
>> >>> This listener will compute it during load test and generate an HTML
>> file
>> >>> at
>> >>> end of test containing it.
>> >>>
>> >>> This listener could be later enhanced to :
>> >>>
>> >>>     - Generate equivalent of Aggregate Report
>> >>>     - Possibly graphs based on chartjs or some other graphing JS
>> Library
>> >>>
>> >> I understand, that apdex is a simple mean to have one metric. As such I
>> >> wonder why we would want to graph it.
>> >
>> > In fact my proposal was larger than just APDEX.
>> > What I am proposing is to implement a report generator that at end of
>> Test
>> > would compute HTML page with:
>> > - APDEX
>> > - Some graphs like:
>> > - Plot of OK/KO  (http://www.chartjs.org/docs/#doughnut-pie-chart)
>> > - Request Summary (what's currently in Aggregate Graph)
>> > http://www.chartjs.org/docs/#bar-chart
>> > - Response Time over time (http://www.chartjs.org/docs/#line-chart)
>> >
>> > I think all this should in fact be computed at end of load test instead
>> of
>> > during it.
>> > The input of this listener would be the generated CSV file, and at end
>> of
>> > Test it would read it an compute all this.
>>
>> In which case it should be a stand-alone app.
>>
>> >
>> >
>> >
>> >> If we want to display a graph of apdex values for different tolerated
>> >> times, than we would have to store all values, which would make the
>> >> listener quite heavy on the memory side.
>> >>
>> >>>
>> >>> Thoughts ?
>> >>>
>> >> How will errors be counted? Sometimes I can cope with errors, as long
>> as
>> >> they are reported fast and sometimes an error would result in a very
>> >> unhappy  consumer.
>> >>
>> > Good catch, I think only successful samples must be taken into account.
>> > Error will count only toward total requests (unsatisfied).
>> >
>> >>
>> >> Regards
>> >>  Felix
>> >>
>> >>
>> >
>> >
>> > --
>> > Cordialement.
>> > Philippe Mouawad.
>>
>
>
> --
> Cordialement.
> Philippe Mouawad.
>
>
>
>

-- 
Cordialement.
Philippe Mouawad.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message