incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "MnemonicProposal" by YanpingWang1
Date Mon, 22 Feb 2016 22:56:47 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "MnemonicProposal" page has been changed by YanpingWang1:
https://wiki.apache.org/incubator/MnemonicProposal?action=diff&rev1=1&rev2=2

  All developers are paid by their employers to contribute to this project. We welcome all
others to contribute to this project after it is open sourced.
  
  ==== Relationships with Other Apache Product ====
+ Relationship with Apache™ Arrow: 
+ Arrow's columnar data layout allows great use of CPU caches & SIMD. It places all data
that relevant to a column operation in a compact format in memory. 
+ 
+ Mnemonic directly puts the whole business object graphs on external heterogeneous storage
media, e.g. off-heap, SSD. It is not necessary to normalize the structures of object graphs
for caching, checkpoint or storing. It doesn’t require developers to normalize their data
object graphs. Mnemonic applications can avoid indexing & join datasets compared to traditional
approaches.
+  
+ Mnemonic can leverage Arrow to transparently re-layout qualified data objects or create
special containers that is able to efficiently hold those data records in columnar form as
one of major performance optimization constructs.
+ 
  Mnemonic can be integrated into various Big Data and Cloud frameworks and applications.
  We are currently working on several Apache projects with Mnemonic:
- For Apache Spark™ we integrated Mnemonic to improve: 
+ For Apache Spark™ we are integrating Mnemonic to improve: 
  a) Local checkpoints
  b) Memory management for caching
  c) Persistent memory datasets input

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message