systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dusenberr...@gmail.com
Subject Re: Experimental code generation
Date Thu, 20 Apr 2017 17:16:21 GMT
Excellent, I'll start experimenting with this in our deep learning work.

Question: what is the relationship between codegen and our rewrite rules?

--

Mike Dusenberry
GitHub: github.com/dusenberrymw
LinkedIn: linkedin.com/in/mikedusenberry

Sent from my iPhone.


> On Apr 20, 2017, at 8:32 AM, Berthold Reinwald <reinwald@us.ibm.com> wrote:
> 
> This is awesome!
> 
> Regards,
> Berthold Reinwald
> IBM Almaden Research Center
> office: (408) 927 2208; T/L: 457 2208
> e-mail: reinwald@us.ibm.com
> 
> 
> 
> From:   Matthias Boehm <mboehm7@googlemail.com>
> To:     dev@systemml.incubator.apache.org
> Date:   04/20/2017 02:41 AM
> Subject:        Experimental code generation
> 
> 
> 
> Hi all,
> 
> meanwhile our new code generation feature is sufficiently stable to enter 
> a
> broader testing with the goal to further improve its capabilities. If
> you're interesting, you can enable this feature via
> 
> <codegen.enabled>true</codegen.enabled>
> 
> in your SystemML-config.xml file. The major advantages are fewer
> intermediates (read and write, incl. potentially fewer evictions), fewer
> scans of inputs and intermediates, and better sparsity exploitation across
> chains of operations.
> 
> On our mainstream algorithms, we see significant improvements compared to
> existing fused operators for scenarios with few features, i.e., when the
> vector and matrix intermediates become the bottleneck, or scripts with
> missing sparsity-exploiting operations. For example, on a 100M x 10 (8GB)
> scenario of L2SVM w/ 20 outer iterations, codegen improves performance 
> from
> 219s (496s without hand-coded fused operators) to 32s.
> 
> So please bring your favorite expressions. If you have interesting 
> scripts,
> please give it a try and share any issues or patterns that we're currently
> not handling very well. Thanks.
> 
> 
> Regards,
> Matthias
> 
> 
> 
> 

Mime
  • Unnamed multipart/alternative (inline, 7-Bit, 0 bytes)
View raw message