incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Trivial Update of "ConcertedProposal" by AtriSharma
Date Tue, 11 Aug 2015 14:15:56 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "ConcertedProposal" page has been changed by AtriSharma:
https://wiki.apache.org/incubator/ConcertedProposal?action=diff&rev1=3&rev2=4

  Concerted is an in memory write less read more engine aimed to provide extreme read performance
with very high degree of concurrency and scalability and focus on minimizing own resource
footprint.
  
  = Proposal =
- Concerted is built on the principal that a new type of workloads are dominating the scene
and are now needed to be supported. These are the large data set analytical workloads being
analyzed or used on large clusters or high power machines. Large analytical workloads depend
on the ability to query large data sets efficiently and in high concurrency while maintaining
semantics such as immediate consistency. An in memory engine designed to support extreme read
queries while providing support for aggregation through various features (such as multidimensional
representation of tuples) will accelerate many usecases around large scale analytics.
+ Concerted is built on the principal that a new type of workload is dominating the scene
and are now needed to be supported. These are the large data set analytical workloads being
analyzed or used on large clusters or high power machines. Large analytical workloads depend
on the ability to query large data sets efficiently and in high concurrency while maintaining
semantics such as immediate consistency. An in memory engine designed to support extreme read
queries while providing support for aggregation through various features (such as multidimensional
representation of tuples) will accelerate many usecases around large scale analytics.
  
  
  = Background =
- Relational databases were built with the cost of physical memory in mind. The cost is no
longer very relevant and physical memory is now available on demand. Another driving factor
behind Concerted is that there is a paradigm shift with big data coming into picture. Disk
IO speeds are more of a bottleneck than ever before. Combining the read dominance of analytical
workload and the speed of in memory structures, Concerted fits the current scene. Also, supporting
OLAP workloads with in memory support for faster read constant queries and joins will be useful.
+ Relational databases were built with the cost of physical memory in mind. The cost is no
longer very relevant and physical memory is now available on demand. Another driving factor
behind Concerted is that there is a paradigm shift with big data coming into picture. Disk
IO speeds are more of a bottleneck than ever before. Combining the read dominance of analytical
workload with the speed of in memory structures, Concerted fits the current scene. Also, supporting
OLAP workloads with in memory support for faster read constant queries and joins will be useful.
  
  = Rationale =
- As explained above, large analytical workloads need an in memory lightweight engine which
supports massive read concurrency, ground level support for aggregations and analytics, extreme
scalability and high read performance, along with the engine being very light itself. Concerted
aims to solve these needs. Concerted looks at three goals to be achieved:
+ As explained above, large analytical workloads need an in memory lightweight engine which
supports massive read concurrency, ground level support for aggregations and analytics, extreme
scalability and high read performance, along with the engine being very light itself. Concerted
aims to solve these needs. Concerted is designed and built with three goals as objectives:
  
  
  Performance

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message