incubator-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Incubator Wiki] Update of "S4Proposal" by FlavioJunqueira
Date Mon, 19 Sep 2011 17:04:29 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Incubator Wiki" for change notification.

The "S4Proposal" page has been changed by FlavioJunqueira:
http://wiki.apache.org/incubator/S4Proposal?action=diff&rev1=5&rev2=6

  
  === Homogeneous Developers ===
  
- The initial set of committers for S4 represent four different companies. This set is diverse
enough for a starting project.
+ The initial set of committers for S4 represent four different companies: A9, Linkedin, Quantbench,
and Yahoo!. This set is diverse enough for a starting project.
  
  === Reliance on Salaried Developers ===
  
@@ -107, +107 @@

   * zookeeper
   * Maven and its usual plug-ins (build time only)
  
- Once we have an S4 extension for Hadoop, we expect developers to write code once and run
it on both platforms with little effort.
+ Compared to existing projects, S4 complements existing functionality in a few ways summarized
below:
+  * Flume: S4 processes streams in a distributed fashion and enables applications to form
arbitrary graphs of processing elements. Flume focuses on accumulating streams of logs in
a centalized repository for batch processing;
+  * Kafka: Kafka is a pub/sub messaging layer that interposes generation of events and processing,
while S4 itself forwards events and processes them in a stream fashion.  
+  * Hadoop: Hadoop focuses on batch processing of large data sets, while S4 is a platform
for stream processing of events. We would like to implement extensions that enable processing
in both platforms with the same code.
  
  === An Excessive Fascination with the Apache Brand ===
  

---------------------------------------------------------------------
To unsubscribe, e-mail: cvs-unsubscribe@incubator.apache.org
For additional commands, e-mail: cvs-help@incubator.apache.org


Mime
View raw message