Mailing-List: contact dev-help@flink.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.incubator.apache.org
MIME-Version: 1.0
In-Reply-To: <87a45c3a-aa20-4810-a3d0-bd3b19a82318@googlegroups.com>
References: <f6ec67a1-f532-48b4-b59e-879fc5602ceb@googlegroups.com>
 <EDA5CC46-6CAF-4733-9908-DABCDA126382@fu-berlin.de>
 <87a45c3a-aa20-4810-a3d0-bd3b19a82318@googlegroups.com>
From: Robert Metzger <rmetzger@apache.org>
Date: Fri, 29 Aug 2014 19:01:36 +0200
Message-ID: 
 <CAGr9p8ATFcJKXeFO7ETY+Q7DnerYvNObS2A64f_XSoUs17e=Hw@mail.gmail.com>
Subject: Fwd: [stratosphere-dev] Spark comparison
To: "dev@flink.incubator.apache.org" <dev@flink.incubator.apache.org>
Cc: Anirvan Basu <nirvanesque.paris@gmail.com>
Content-Type: multipart/alternative; boundary=001a11c1271e4fc17d0501c79c63

--001a11c1271e4fc17d0501c79c63
Content-Type: text/plain; charset=UTF-8

Forwarding the message to the new mailing list ...

---------- Forwarded message ----------
From: Nirvanesque <nirvanesque.paris@gmail.com>
Date: Fri, Aug 29, 2014 at 1:57 PM
Subject: Re: [stratosphere-dev] Spark comparison
To: stratosphere-dev@googlegroups.com


Ufuk and the Flink team,

You and your team are familiar by now with this comparison (Master thesis
of Ze Ni in the KTH Institute)
http://www.diva-portal.org/smash/get/diva2:605106/FULLTEXT01.pdf

I would like to know your viewpoints in this direction?

Thanks in advance,
Anirvan


On Tuesday, December 3, 2013 6:19:57 PM UTC+1, Ufuk Celebi wrote:

> Hey Ankur,
>
> I like the idea of a comparison matrix. We tried to do something similar
> with Hadoop already (parts of it are on the front page of our website),
> which we used for a local summit here. Comparing Stratosphere to Spark in
> this way would be a natural extension to this. ;-)
>
> Internally, we ran some benchmarks against 0.7.3 (unfortunately right
> before the 0.8 release). We didn't publish the results as there are certain
> aspects that make the comparison unfair (for example we have no fault
> tolerance right now whereas Spark does). As soon as we (re-)introduce fault
> tolerance mechanisms, we will re-run the benchmarks.
>
> I can publish the code for the Stratosphere and Spark programs we looked
> at on GitHub. If I add Scala versions of the Stratosphere programs, this
> will also go to your proposed direction of having a direct comparison.
>
> Is there any specific use case where you want to see numbers? Or is it
> more like a general thing where you want to see how both systems perform?
>
> Best,
>
> Ufuk
>
> On 03 Dec 2013, at 18:03, Ankur Chauhan <an...@malloc64.com> wrote:
>
> Hi all,
>
>
> Sitting at spark-summit 2013, I was interested in figuring out if anyone
> has done a feature comparison and or benchmarks against spark/storm/etc.
> This may also serve as a "compatibility matrix" and would help a lot when
> people want to compare the two projects and help us understand what are the
> strengths and weakness of each project.
>
> -- Ankur
>
> --
> You received this message because you are subscribed to the Google Groups
> "stratosphere-dev" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to stratosphere-d...@googlegroups.com.
>
> Visit this group at http://groups.google.com/group/stratosphere-dev.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>  --
You received this message because you are subscribed to the Google Groups
"stratosphere-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to stratosphere-dev+unsubscribe@googlegroups.com.
Visit this group at http://groups.google.com/group/stratosphere-dev.
For more options, visit https://groups.google.com/d/optout.

--001a11c1271e4fc17d0501c79c63--