incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "RheosProposal" by Connie Yang
Date Thu, 02 Feb 2017 18:20:35 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "RheosProposal" page has been changed by Connie Yang:
https://wiki.apache.org/incubator/RheosProposal?action=diff&rev1=2&rev2=3

Comment:
Fixed formatting issue

  
  Rheos includes:
  
- Streaming As A Service (StraaS): A cloud service that provisions and provides full lifecycle
management (LCM) for Zookeeper, Kafka, Storm, and MirrorMaker clusters.  StraaS is built on
a modular architecture with a pluggable extension and frameworks.  This combination allows
StraaS to create and perform LCM on a stream pipeline running on any cloud platforms (such
as OpenStack, AWS, Google Cloud and etc.).
+ '''Streaming As A Service (StraaS):''' A cloud service that provisions and provides full
lifecycle management (LCM) for Zookeeper, Kafka, Storm, and MirrorMaker clusters.  StraaS
is built on a modular architecture with a pluggable extension and frameworks.  This combination
allows StraaS to create and perform LCM on a stream pipeline running on any cloud platforms
(such as OpenStack, AWS, Google Cloud and etc.).
  
- Stream Metadata Service: A metadata system that provides a system of record for each stream
and the associated producer and consumers known to the system.  The recorded information includes
+ '''Stream Metadata Service:''' A metadata system that provides a system of record for each
stream and the associated producer and consumers known to the system.  The recorded information
includes
- the physical  (cluster) location of a topic or a stream processing job/topology
+ * the physical  (cluster) location of a topic or a stream processing job/topology
- data durability, retention policy, partition, producer, consumer information
+ * data durability, retention policy, partition, producer, consumer information
- Source and target data mirroring information
+ * Source and target data mirroring information
- topic schema information
+ * topic schema information
- and more
+ * and more
  
- Stream Discovery:  Prior to accessing a stream or deploying a stream processing job, one
must “register” the Kafka topic, stream producer/consumer or the job with the Stream Metadata
Service.  With this, Kafka topics, broker list along with the associated schemas can easily
be discovered or browsed via Rheos Portal or REST API.  That is, no hard coding of broker
list in client code!
+ '''Stream Discovery:'''  Prior to accessing a stream or deploying a stream processing job,
one must “register” the Kafka topic, stream producer/consumer or the job with the Stream
Metadata Service.  With this, Kafka topics, broker list along with the associated schemas
can easily be discovered or browsed via Rheos Portal or REST API.  That is, no hard coding
of broker list in client code!
  
- Kafka Proxy Server: To allow any out-of-the-box tool, framework, and programming language
to seamlessly produce or consume data in Rheos, a Rheos Kafka proxy server that implements
Kafka Protocol is provided to intercept the initial client request so that it can identify
which Kafka cluster the topic resides on via the Metadata Service.
+ '''Kafka Proxy Server:''' To allow any out-of-the-box tool, framework, and programming language
to seamlessly produce or consume data in Rheos, a Rheos Kafka proxy server that implements
Kafka Protocol is provided to intercept the initial client request so that it can identify
which Kafka cluster the topic resides on via the Metadata Service.
  
- Operation Management Service: rheos performs stream, producer, consumer life cycle management
operations with a set of pre-defined Standard Operation Procedure (SOP) in the Operation Management
Service.  Each SOP has a series of steps that need to be performed on the Guest instance via
StraaS.
+ '''Operation Management Service:''' rheos performs stream, producer, consumer life cycle
management operations with a set of pre-defined Standard Operation Procedure (SOP) in the
Operation Management Service.  Each SOP has a series of steps that need to be performed on
the Guest instance via StraaS.
  
- Data Mirroring Service: A service that is built around Kafka’s MirrorMaker.  It is used
to set up Mirror Maker instances and mirror a group of topics from a Kafka cluster to one
or more target Kafka clusters via a REST API.   Through the API, one can start and stop the
mirroring of a topic group.
+ '''Data Mirroring Service:''' A service that is built around Kafka’s MirrorMaker.  It
is used to set up Mirror Maker instances and mirror a group of topics from a Kafka cluster
to one or more target Kafka clusters via a REST API.   Through the API, one can start and
stop the mirroring of a topic group.
  
  Data Mirroring is used to mirror Kafka data across regions and within a single region across
availability zones for high availability reasons.  In addition, Data Mirroring is used to
provide data movement from one security zone to another.
  
@@ -85, +85 @@

  
  The core developers of Rheos team plan to work full time on this project. There is very
little risk of Rheos getting orphaned since at least one large company (eBay) is extensively
using it as their near real-time data platform in production.
  
- === Inexperience with Open Source ==
+ === Inexperience with Open Source ===
  
  eBay believes strongly in open source and the exchange of information to advance new ideas
and work. Examples of this commitment are active OSS projects such as Apache Kylin (http://kylin.apache.org/)
and Apache Eagle (https://eagle.apache.org/).  Our submission to the Apache Software Foundation
is a logical extension of our commitment to open source software.
  
@@ -101, +101 @@

  
  Rheos directly interoperates with or utilizes the following Apache projects, libraries,
and frameworks
  
- Basic: 
+ '''Basic:'''
  
  * Apache Maven 
  * Apache Commons
  * Apache Logging Services
  * Google Guava
  
- Distributed computing:
+ '''Distributed computing:'''
  * Apache Zookeeper
  * Apache Curator
  * Apache Kafka
  * Apache Storm
  
- Data I/O, frameworks and libraries:
+ '''Data I/O, frameworks and libraries:'''
  * Apache Avro
  * Confluent.io Schema Registry
  * Jackson
  * OpenStack Common Libraries (Oslo)
  * Taskflow
  
- REST Service:
+ '''REST Service:'''
  * Spring
  
  
@@ -153, +153 @@

  === Mailing List ===
  
  rheos-private for private PMC discussions (with moderated subscriptions)
- dev@rheos.incubator.apache.org
+ * dev@rheos.incubator.apache.org
- user@rheos.incubator.apache.org
+ * user@rheos.incubator.apache.org
- private@rheos.incubator.apache.org
+ * private@rheos.incubator.apache.org
- commits@rheos.incubator.apache.org
+ * commits@rheos.incubator.apache.org
  
  === Source Control ===
  
@@ -175, +175 @@

  
  == Initial Committers ==
  
- Ankur Bansal [now at Uber]
+ * Ankur Bansal [now at Uber]
- Michael Chiocca [ mchiocca@ebay.com ]
+ * Michael Chiocca [ mchiocca@ebay.com ]
- Lubin Liu [ lubliu@ebay.com ]
+ * Lubin Liu [ lubliu@ebay.com ]
- Subash Ramanathan [ sramanathan@ebay.com ]
+ * Subash Ramanathan [ sramanathan@ebay.com ]
- Viswa Vutharka [ vvutharkar@ebay.com ]
+ * Viswa Vutharka [ vvutharkar@ebay.com ]
- Tao Xiao [ taxiao@ebay.com ]
+ * Tao Xiao [ taxiao@ebay.com ]
- Xin Xu [ xinxu1@ebay.com ]
+ * Xin Xu [ xinxu1@ebay.com ]
- Connie Yang [ cyang@ebay.com ]
+ * Connie Yang [ cyang@ebay.com ]
- Wayne Zhou [ jianbzhou@ebay.com ]
+ * Wayne Zhou [ jianbzhou@ebay.com ]
  
  == Affiliations ==
  
@@ -204, +204 @@

  == Sponsoring Entity ==
  
  The Apache Incubator
- 

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message