incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "ConcurProposal" by JitendraPandey
Date Mon, 21 Nov 2016 22:09:39 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "ConcurProposal" page has been changed by JitendraPandey:
https://wiki.apache.org/incubator/ConcurProposal?action=diff&rev1=5&rev2=6

  Concur is implemented as an independent RAFT library that can be used by any application
to manage their replicated logs or replicated state machines. The implementation closely follows
the original design proposed in the RAFT paper.
   
  == Background ==
- Replicated log is a frequently used technique in distributed systems for reliability and
parallelism. The consistency of replicas is an important requirement to ensure the correctness
of the applications accessing the data in these replicas. Many algorithms have been proposed
and used to maintain consistency and correctness. RAFT paper was proposed on 2012 and has
gained significant popularity since then to manage the replicated logs and replicated state
in many popular projects. Data replication is a requirement for many projects in ASF ecosystem
as well for example Apache Hadoop, Apache HBase, Apache Kudu etc. We believe the Apache Concur
project can provide a single implementation of RAFT that can fulfill the needs these systems
and strengthen the ASF ecosystem.
+  Replicated log is a frequently used technique in distributed systems for reliability and
parallelism. The consistency of replicas is an important requirement to ensure the correctness
of the applications accessing the data in these replicas. Many algorithms have been proposed
and used to maintain consistency and correctness. RAFT paper was proposed on 2012 and has
gained significant popularity since then to manage the replicated logs and replicated state
in many popular projects. Data replication is a requirement for many projects in ASF ecosystem
as well for example Apache Hadoop, Apache HBase, Apache Kudu etc. We believe the Apache Concur
project can provide a single implementation of RAFT that can fulfill the needs these systems
and strengthen the ASF ecosystem.
  
  
  == Rationale ==
- There are a few RAFT implementations[2], but none are a part of ASF. Apache Concur is significantly
different because one of the critical goals of the project is to use it as a library with
pluggability for different RPC, Raft log and state machine implementations. 
+  There are a few RAFT implementations[2], but none are a part of ASF. Apache Concur is significantly
different because one of the critical goals of the project is to use it as a library with
pluggability for different RPC, Raft log and state machine implementations. 
  Another important goal of Apache Concur is to provide high throughput for large ingest rates
of data, with data pipeline support. This will simplify the problem of data replication across
the board.
  Apache DistributedLog project[3] (in incubation) provides a consistent and replicated log
service. However, Apache Concur is different as it provides a library that other projects
can use to implement their own replicated log, without deploying another service.
  
  
- == Current Status == 
+ == Current Status ==
- The source code is available with Apache v2 license at https://github.com/hortonworks/concur.
Significant amount of code has been added and basic functionality of RAFT is available for
testing. 
+  The source code is available with Apache v2 license at https://github.com/hortonworks/concur.
Significant amount of code has been added and basic functionality of RAFT is available for
testing. 
  
   
- == Meritocracy == 
+ == Meritocracy ==
  We plan to invest in supporting meritocracy. We intend to invite additional developers to
participate. We will encourage and monitor community participation so that privileges can
be extended to those that contribute.
  
  

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message