aurora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ahmed Aley <>
Subject GSoC work for Aurora and some updates
Date Thu, 22 May 2014 06:15:09 GMT

I am Ahmed Ali-Eldin <>, a PhD student at
UmeƄ University, Sweden (It is up
). I am working with @MarkCC on integrating a distributed logging
framework with Aurora and building an analytics framework on top to analyze
the logged data.
We started off by looking into different logging frameworks
Scribe <>,
Flume <>). We chose Suro coupled with Kafka out of
these for different reasons.
i- It has been built to allow scale-up and down (elastic).
ii- It is quite flexible with a Kafka sink giving us access to all Kafka
iii- It has an S3 sink making it a suitable solution for more scenarios.
iv- I got a tip from someone I know at Netflix on Suro benchmarking results.
v- it is an active project

Based on the above, I have started some experiments with Suro and will be
looking at its integration with Aurora this weekend. I can not make any
statements on if Suro (coupled with kafka) is "the best" solution for
distributed logging but it looks very promising till now. I will hopefully
send some results/updates late next week.


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message