systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nakul Jindal <naku...@gmail.com>
Subject Re: SYSTEMML-1451: Performance Regression Tests
Date Sun, 14 May 2017 05:53:22 GMT
Hi Krishna,

I think the intention is to compare the performance to previous versions of
systemml.

We can add a csv or excel file that contains performance info from previous
versions to the repo and whena performance test is run, new numbers from
the performance run can be added into that csv/excel file and the graph
generated automatically. There are python apis to manipulate excel files,
but I have not looked at what they can and cannot do.

We could also keep the spreadsheet online (on Google docs for instance) and
have the tests update that when the user that runs the perf provides the
appropriate login credentials.

Thoughts?

-Nakul



On Fri, May 12, 2017 at 9:52 PM, Krishna Kalyan <krishnakalyan3@gmail.com>
wrote:

> Hello All,
> I had a questions on SYSTEMML-1451
> (https://issues.apache.org/jira/browse/SYSTEMML-1451)
>
> I am not quite sure how we could achieve the 4th point  (Automatically
> compare this performance to previous version to check for performance
> regressions)
> I was wondering if the expectation is to download an older versions of
> SystemML jar (previous release) from maven repository and run performance
> tests?. Please your initial thoughts on how to go about this?.
>
> Regards,
> Krishna
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message