hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shahab Yunus <shahab.yu...@gmail.com>
Subject Re: Hadoop or spark
Date Fri, 10 Apr 2015 13:28:18 GMT
Thanks for this. Slide# 77 and 87 are pretty good. Quite a few of it,  is
new stuff and still emerging.

Regards,
Shahab

On Fri, Apr 10, 2015 at 9:10 AM, Peyman Mohajerian <mohajeri@gmail.com>
wrote:

> There actually is such a discussion, e.g.:
>
> http://www.slideshare.net/sbaltagi/spark-or-hadoop-is-it-an-eitheror-proposition-by-slim-baltagi
>
> you can have a standalone Spark cluster with no dependency on Hadoop.
>
> On Fri, Apr 10, 2015 at 5:47 AM, Shahab Yunus <shahab.yunus@gmail.com>
> wrote:
>
>> I hope I am not misunderstanding your question but I don't think there is
>> a comparison between Spark and Hadoop. They are different things.
>>
>> Hadoop is a platform on which you can run Yarn, HBase and even Spark.
>> E.g. Cloudera's Hadoop distribution has Spark, Hbase, Impala, Pig etc. as
>> part of its installation. Spark can run within a Hadoop cluster deployment.
>>
>> I think a more apt comparison would be something like whether you should
>> use regular MapReduce on Yarn on Hadoop OR Spark on Hadoop.
>>
>> Or even more direct would be Spark vs. Storm, which has been discussed
>> here.
>> http://marc.info/?l=hadoop-user&m=140434265901449
>>
>> Regards,
>> Shahab
>>
>>
>>
>> On Fri, Apr 10, 2015 at 1:08 AM, Ashutosh Kumar <ashutosh.k78@gmail.com>
>> wrote:
>>
>>> How do I decide whether I should go for Hadoop or Spark for a greenfield
>>> project . I tried to find out and looks like Spark can do everything that
>>> hadoop can do. Appreciate your thoughts on it.
>>>
>>> Thanks
>>>
>>>
>>
>

Mime
View raw message