incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "ConcurProposal" by JitendraPandey
Date Mon, 21 Nov 2016 23:13:49 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "ConcurProposal" page has been changed by JitendraPandey:
https://wiki.apache.org/incubator/ConcurProposal?action=diff&rev1=7&rev2=8

  Concur is implemented as an independent RAFT library that can be used by any application
to manage their replicated logs or replicated state machines. The implementation closely follows
the original design proposed in the RAFT paper.
   
  == Background ==
-  Replicated log is a frequently used technique in distributed systems for reliability and
parallelism. The consistency of replicas is an important requirement to ensure the correctness
of the applications accessing the data in these replicas. Many algorithms have been proposed
and used to maintain consistency and correctness. RAFT paper was proposed on 2012 and has
gained significant popularity since then to manage the replicated logs and replicated state
in many popular projects. Data replication is a requirement for many projects in ASF ecosystem
as well for example Apache Hadoop, Apache HBase, Apache Kudu etc. We believe the Apache Concur
project can provide a single implementation of RAFT that can fulfill the needs these systems
and strengthen the ASF ecosystem.
+ Replicated log is a frequently used technique in distributed systems for reliability and
parallelism. The consistency of replicas is an important requirement to ensure the correctness
of the applications accessing the data in these replicas. Many algorithms have been proposed
and used to maintain consistency and correctness. RAFT paper was proposed on 2012 and has
gained significant popularity since then to manage the replicated logs and replicated state
in many popular projects. Data replication is a requirement for many projects in ASF ecosystem
as well for example Apache Hadoop, Apache HBase, Apache Kudu etc. We believe the Apache Concur
project can provide a single implementation of RAFT that can fulfill the needs these systems
and strengthen the ASF ecosystem.
  
  
  == Rationale ==
-  There are a few RAFT implementations[2], but none are a part of ASF. Apache Concur is significantly
different because one of the critical goals of the project is to use it as a library with
pluggability for different RPC, Raft log and state machine implementations. Another important
goal of Apache Concur is to provide high throughput for large ingest rates of data, with data
pipeline support. This will simplify the problem of data replication across the board.Apache
DistributedLog project[3] (in incubation) provides a consistent and replicated log service.
However, Apache Concur is different as it provides a library that other projects can use to
implement their own replicated log, without deploying another service.
+ There are a few RAFT implementations[2], but none are a part of ASF. Apache Concur is significantly
different because one of the critical goals of the project is to use it as a library with
pluggability for different RPC, Raft log and state machine implementations. Another important
goal of Apache Concur is to provide high throughput for large ingest rates of data, with data
pipeline support. This will simplify the problem of data replication across the board.Apache
DistributedLog project[3] (in incubation) provides a consistent and replicated log service.
However, Apache Concur is different as it provides a library that other projects can use to
implement their own replicated log, without deploying another service.
  
  
  == Current Status ==
-  The source code is available with Apache v2 license at https://github.com/hortonworks/concur.
Significant amount of code has been added and basic functionality of RAFT is available for
testing. 
+ The source code is available with Apache v2 license at https://github.com/hortonworks/concur.
Significant amount of code has been added and basic functionality of RAFT is available for
testing. 
  
   
  == Meritocracy ==
@@ -25, +25 @@

  
  
  == Community ==
-    The developers on the initial committers list are experienced in the ASF ecosystem:
+ The developers on the initial committers list are experienced in the ASF ecosystem:
     * Jing Zhao
     * Tsz Wo Nicholas Sze
     * Li Lu

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message