systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Krishna Kalyan <krishnakaly...@gmail.com>
Subject Re: SYSTEMML-1451: Performance Regression Tests
Date Thu, 18 May 2017 02:56:04 GMT
Hello Nakul,
Thanks for clarifying this. I will have a look at google sheets API and see
how this can be achieved.

Cheers,
Krishna

On Sun, May 14, 2017 at 1:53 AM, Nakul Jindal <nakul02@gmail.com> wrote:

> Hi Krishna,
>
> I think the intention is to compare the performance to previous versions of
> systemml.
>
> We can add a csv or excel file that contains performance info from previous
> versions to the repo and whena performance test is run, new numbers from
> the performance run can be added into that csv/excel file and the graph
> generated automatically. There are python apis to manipulate excel files,
> but I have not looked at what they can and cannot do.
>
> We could also keep the spreadsheet online (on Google docs for instance) and
> have the tests update that when the user that runs the perf provides the
> appropriate login credentials.
>
> Thoughts?
>
> -Nakul
>
>
>
> On Fri, May 12, 2017 at 9:52 PM, Krishna Kalyan <krishnakalyan3@gmail.com>
> wrote:
>
> > Hello All,
> > I had a questions on SYSTEMML-1451
> > (https://issues.apache.org/jira/browse/SYSTEMML-1451)
> >
> > I am not quite sure how we could achieve the 4th point  (Automatically
> > compare this performance to previous version to check for performance
> > regressions)
> > I was wondering if the expectation is to download an older versions of
> > SystemML jar (previous release) from maven repository and run performance
> > tests?. Please your initial thoughts on how to go about this?.
> >
> > Regards,
> > Krishna
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message