incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "RheosProposal" by Connie Yang
Date Thu, 02 Feb 2017 18:23:03 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "RheosProposal" page has been changed by Connie Yang:
https://wiki.apache.org/incubator/RheosProposal?action=diff&rev1=3&rev2=4

  While Kafka has given us core capabilities in stream processing, managing a large, highly
distributed, real-time data pipelines running on cloud spanning across security zones and
data centers is hard without automation, and supporting services.  Rheos is intended to address
majority of those concerns.
  
  With Rheos, you can:
- * create and perform lifecycle management on a data pipeline that consists of Kafka, Zookeeper,
and the supported stream processing technologies such as Storm, Flink and etc.
+  * create and perform lifecycle management on a data pipeline that consists of Kafka, Zookeeper,
and the supported stream processing technologies such as Storm, Flink and etc.
- * provide a real-time data pipeline at scale in a highly available manner
+  * provide a real-time data pipeline at scale in a highly available manner
- * browse existing or discover new streams
+  * browse existing or discover new streams
- * provide shared and curated streams in a multi-tenant distributed cloud environment spanning
across data centers
+  * provide shared and curated streams in a multi-tenant distributed cloud environment spanning
across data centers
- * provide a data pipeline that is easy to use by the developers and easy to manage
+  * provide a data pipeline that is easy to use by the developers and easy to manage
- * mirror data streams from one datacenter to another for HA reasons
+  * mirror data streams from one datacenter to another for HA reasons
- * move data streams across security zones
+  * move data streams across security zones
  
  == Overview of Rheos ==
  
@@ -26, +26 @@

  '''Streaming As A Service (StraaS):''' A cloud service that provisions and provides full
lifecycle management (LCM) for Zookeeper, Kafka, Storm, and MirrorMaker clusters.  StraaS
is built on a modular architecture with a pluggable extension and frameworks.  This combination
allows StraaS to create and perform LCM on a stream pipeline running on any cloud platforms
(such as OpenStack, AWS, Google Cloud and etc.).
  
  '''Stream Metadata Service:''' A metadata system that provides a system of record for each
stream and the associated producer and consumers known to the system.  The recorded information
includes
- * the physical  (cluster) location of a topic or a stream processing job/topology
+  * the physical  (cluster) location of a topic or a stream processing job/topology
- * data durability, retention policy, partition, producer, consumer information
+  * data durability, retention policy, partition, producer, consumer information
- * Source and target data mirroring information
+  * Source and target data mirroring information
- * topic schema information
+  * topic schema information
- * and more
+  * and more
  
  '''Stream Discovery:'''  Prior to accessing a stream or deploying a stream processing job,
one must “register” the Kafka topic, stream producer/consumer or the job with the Stream
Metadata Service.  With this, Kafka topics, broker list along with the associated schemas
can easily be discovered or browsed via Rheos Portal or REST API.  That is, no hard coding
of broker list in client code!
  
@@ -103, +103 @@

  
  '''Basic:'''
  
- * Apache Maven 
+  * Apache Maven 
- * Apache Commons
+  * Apache Commons
- * Apache Logging Services
+  * Apache Logging Services
- * Google Guava
+  * Google Guava
  
  '''Distributed computing:'''
- * Apache Zookeeper
+  * Apache Zookeeper
- * Apache Curator
+  * Apache Curator
- * Apache Kafka
+  * Apache Kafka
- * Apache Storm
+  * Apache Storm
  
  '''Data I/O, frameworks and libraries:'''
- * Apache Avro
+  * Apache Avro
- * Confluent.io Schema Registry
+  * Confluent.io Schema Registry
- * Jackson
+  * Jackson
- * OpenStack Common Libraries (Oslo)
+  * OpenStack Common Libraries (Oslo)
- * Taskflow
+  * Taskflow
  
  '''REST Service:'''
- * Spring
+  * Spring
  
  
  Being part of Apache’s Incubation community, could help with a closer collaboration among
these four projects and as well as others.
@@ -153, +153 @@

  === Mailing List ===
  
  rheos-private for private PMC discussions (with moderated subscriptions)
- * dev@rheos.incubator.apache.org
+  * dev@rheos.incubator.apache.org
- * user@rheos.incubator.apache.org
+  * user@rheos.incubator.apache.org
- * private@rheos.incubator.apache.org
+  * private@rheos.incubator.apache.org
- * commits@rheos.incubator.apache.org
+  * commits@rheos.incubator.apache.org
  
  === Source Control ===
  
@@ -175, +175 @@

  
  == Initial Committers ==
  
- * Ankur Bansal [now at Uber]
+  * Ankur Bansal [now at Uber]
- * Michael Chiocca [ mchiocca@ebay.com ]
+  * Michael Chiocca [ mchiocca@ebay.com ]
- * Lubin Liu [ lubliu@ebay.com ]
+  * Lubin Liu [ lubliu@ebay.com ]
- * Subash Ramanathan [ sramanathan@ebay.com ]
+  * Subash Ramanathan [ sramanathan@ebay.com ]
- * Viswa Vutharka [ vvutharkar@ebay.com ]
+  * Viswa Vutharka [ vvutharkar@ebay.com ]
- * Tao Xiao [ taxiao@ebay.com ]
+  * Tao Xiao [ taxiao@ebay.com ]
- * Xin Xu [ xinxu1@ebay.com ]
+  * Xin Xu [ xinxu1@ebay.com ]
- * Connie Yang [ cyang@ebay.com ]
+  * Connie Yang [ cyang@ebay.com ]
- * Wayne Zhou [ jianbzhou@ebay.com ]
+  * Wayne Zhou [ jianbzhou@ebay.com ]
  
  == Affiliations ==
  
@@ -197, +197 @@

  
  === Nominated Mentors ===
  
- * Julian Hyde [ jhyde@hortonworks.com ]
+  * Julian Hyde [ jhyde@hortonworks.com ]
- * Taylor Goetz [ tgoetz@hortonworks.com ]
+  * Taylor Goetz [ tgoetz@hortonworks.com ]
- * Henry Saputra [ hsaputra@ebay.com ]
+  * Henry Saputra [ hsaputra@ebay.com ]
  
  == Sponsoring Entity ==
  
  The Apache Incubator
+ 

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message