systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Krishna Kalyan <krishnakaly...@gmail.com>
Subject Performance Test: Phase-2 Release
Date Wed, 02 Aug 2017 14:27:23 GMT
Dear SystemML Community,
Thank you so much for your support and guidance so far.

Our Phase-2 release includes:
- HDFS support
- Support to upload pref-test results automatically to google docs +
automatically summarise data from google docs between two versions.
- Support for additional arguments in our perf test suit like debug, stats,
config, master etc...

I would really appreciate if the community could use / test our performance
test suit and share their valuable feedback. (Please refer to the
documentation below to get started testing our performance test suit. Also
if something is unclear please let me know.)

Documentation
https://github.com/apache/systemml/blob/master/docs/python-performance-test.md

About Google Docs:
We need an api client key to upload our performance test results to google
docs. (Currently I am using my personal email account + personal api client
key). I was wondering if a separate gmail account should be created for
SystemML community and access to google docs / api client key can be shared
with committers?. (Results from my machine can be found in the url at the
end of this mail)

Phase 3:
We have another 4 weeks before GSoC ends and some tasks I will be working
on:
a) Offline CSV support in addition to google docs
b) Plots comparing algorithm performance across different releases
c) I would also be interested in refactoring / improving existing DML
scripts. (@Deron could you please let me know how I could begin
contributing here?)
d) I would also like to know about other features the community would like
us to build / add in our performance test suit. (We will definitely do our
best to work on it)

Again, thank you so much for your time and effort.

Cheers,
Krishna


Results obtained in my local system can be found below
https://docs.google.com/spreadsheets/d/1sIAPKGFph_X64ZiKMNc16IS5XiDcM23evelzBF3uwgM/edit#gid=0

My System Config
16 GB ram
OSX
2.5 GHz, Intel i5

[Phase1 PR]
https://github.com/apache/systemml/pull/537

[Phase2 PR]
https://github.com/apache/systemml/pull/575

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message