incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "ConcurProposal" by JitendraPandey
Date Wed, 23 Nov 2016 00:00:55 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "ConcurProposal" page has been changed by JitendraPandey:
https://wiki.apache.org/incubator/ConcurProposal?action=diff&rev1=14&rev2=15

  Concur is implemented as an independent RAFT library that can be used by any application
to manage their replicated logs or replicated state machines. The implementation closely follows
the original design proposed in the RAFT paper.
   
  == Background ==
- Replicated log is a frequently used technique in distributed systems for reliability and
parallelism. The consistency of replicas is an important requirement to ensure the correctness
of the applications accessing the data in these replicas. Many algorithms have been proposed
and used to maintain consistency and correctness. RAFT paper was proposed in 2012 and has
gained significant popularity since then to manage the replicated logs and replicated state
in many popular projects. Data replication is a requirement for many projects in ASF ecosystem
as well for example Apache Hadoop, Apache HBase, Apache Kudu etc. We believe the Apache Concur
project can provide an implementation of RAFT that can fulfill the needs similar to these
systems and strengthen the ASF ecosystem.
+ Replicated log is a frequently used technique in distributed systems for reliability and
parallelism. The consistency of replicas is an important requirement to ensure the correctness
of the applications accessing the data in these replicas. Many algorithms have been proposed
and used to maintain consistency and correctness. RAFT paper was proposed in 2012 and has
gained significant popularity since then to manage the replicated logs and replicated state
in many popular projects. Data replication is a requirement for many projects in ASF ecosystem
for example Apache Hadoop, Apache HBase etc. We believe the Apache Concur project can provide
an implementation of RAFT that can fulfill the needs similar to these systems and strengthen
the ASF ecosystem.
  
  
  == Rationale ==
- There are a few RAFT implementations[2], but none are a part of ASF. Apache Concur is significantly
different because one of the critical goals of the project is to use it as a library with
pluggability for different RPC, Raft log and state machine implementations. Another important
goal of Apache Concur is to provide high throughput for large ingest rates of data, with data
pipeline support. This will simplify the problem of data replication across the board. Apache
DistributedLog project[3] (in incubation) provides a replicated log service. However, Apache
Concur is different as it provides a library that other projects can use to implement their
own replicated log, without deploying another service.
+ There are a few RAFT implementations[2], but none are a part of ASF. Apache Concur is significantly
different because one of the critical goals of the project is to use it as a library with
pluggability for different RPC, Raft log and state machine implementations. Another important
goal of Apache Concur is to provide high throughput for large ingest rates of data, with data
pipeline support. This will simplify the problem of data replication across the board. Apache
DistributedLog project[3] (in incubation) provides a replicated log service. However, Apache
Concur is different as it provides a library that other projects can use to implement their
own replicated state machine, without deploying another service. Apache Kudu uses RAFT protocol,
but it has its own implementation in C++. 
  
  
  == Current Status ==

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message