systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tsuyoshi Ozawa <oz...@apache.org>
Subject Re: [DISCUSS] Project Roadmap
Date Tue, 22 Dec 2015 04:19:58 GMT
Hi Lucano,

Thank you for the summary! It clarify what we can do. I'm interested
in runtime optimizations.
BTW, is it possible for us to write them down on wiki to clarify where
we are now like Hadoop's roadmap page?

https://wiki.apache.org/hadoop/Roadmap

Thanks,
- Tsuyoshi

On Mon, Dec 21, 2015 at 8:09 PM, Matthias Boehm <mboehm@us.ibm.com> wrote:
> From my perspective, our roadmap for 2016 should cover the following
> SystemML engine extensions with regard to runtime (R), optimizer (O), as
> well as language and tools (L). Each sub-bullet in the following list will
> be further broken down into multiple JIRAs.
>
> R1) Extended Scale-Up Backend
> * Support for large dense matrix blocks >16GB
> * Extended multi-threaded operations (e.g., ctable, aggregate)
> * NUMA-awareness (partitioning and multi-threaded operations)
> * Extended update-in-place support
>
> R2) Generalized Matrix Block Library
> * Investigation interface design (abstraction)
> * Boolean matrices and operations
> * Different types of sparse matrix blocks
> * Additional physical runtime operators
>
> R3) HW Accelerators / Low-Level Optimizations
> * Exploit GPU BLAS libraries (integration)
> * Custom GPU kernels for complex operator patterns
> * Low-level optimizations (source code gen, compression)
>
> O1) Global Program Optimization
> * Global data flow optimization (rewrites, holistic)
> * Code motion (for cse, program block merge)
> * Advanced loop vectorization (common patterns)
> * Advanced function inlining (inlining multi-block functions)
> * Extended inter-procedure analysis (independent constant propagation)
>
> O2) Cost Model
> * Update memory budgets wrt Spark 1.6 dynamic memory management
> * Extended runtime cost model for Spark (incl lazy evaluation)
> * Extended execution type selection based on FLOPs
>
> O3) Dynamic Rewrites
> * Extended matrix mult chain opt (sparsity, rewrites, ops)
> * Rewrites exploiting additional statistics (e.g., min/max)
>
> O4) Optimizer Support R2/R3
> * Extended memory estimates for R2/R3
> * Type inference for matrix operations
> * Extended cost model and operator selection
>
> L1) Extended Spark Interfaces
> * Hardening MLContext (config, lazy eval, cleanup)
> * Extended Spark ML wrappers for all algorithms
> * Investigation of embedded DSL with sufficient optimization scope
>
> L2) New/Extended Builtin Functions
> * Second order functions (apply), incl optimizer/runtime support
> * Generalization of existing functions from vectors to matrices
> * Additional builtin functions (e.g., var, sd, rev, rep, sign, etc)
>
> L3) Extended Dev Tools
> * Extended statistics output (e.g., wrt Spark lazy evaluation)
> * Extended benchmarking (data generators, test suites, etc)
>
> Once we create the individual JIRAs, we should also include a list of new
> algorithms as well as additional documentation guides.
>
>
> Regards,
> Matthias
>
>
> Luciano Resende ---11/20/2015 01:50:16 AM---Now that we are done with our
> 0.8.0 (non-apache) Release, and have most of our infrastructure in pl
>
> From: Luciano Resende <luckbr1975@gmail.com>
> To: dev@systemml.incubator.apache.org
> Date: 11/20/2015 01:50 AM
> Subject: [DISCUSS] Project Roadmap
>
> ________________________________
>
>
>
> Now that we are done with our 0.8.0 (non-apache) Release,  and have most of
> our infrastructure in place at Apache, I would like to start some
> discussion around what are some high level items you see we could be
> working on the short/medium term, and start building a Roadmap, so new
> contributors can easily find areas of their interest to start contributing.
>
> Let's have items listed on this thread, and once we have our JIRA
> available, we start updating it there.
>
> Thanks
>
> --
> Luciano Resende
> http://people.apache.org/~lresende
> http://twitter.com/lresende1975
> http://lresende.blogspot.com/
>
>

Mime
View raw message