hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peyman Mohajerian <mohaj...@gmail.com>
Subject Re: Hadoop or spark
Date Fri, 10 Apr 2015 13:10:38 GMT
There actually is such a discussion, e.g.:

you can have a standalone Spark cluster with no dependency on Hadoop.

On Fri, Apr 10, 2015 at 5:47 AM, Shahab Yunus <shahab.yunus@gmail.com>

> I hope I am not misunderstanding your question but I don't think there is
> a comparison between Spark and Hadoop. They are different things.
> Hadoop is a platform on which you can run Yarn, HBase and even Spark. E.g.
> Cloudera's Hadoop distribution has Spark, Hbase, Impala, Pig etc. as part
> of its installation. Spark can run within a Hadoop cluster deployment.
> I think a more apt comparison would be something like whether you should
> use regular MapReduce on Yarn on Hadoop OR Spark on Hadoop.
> Or even more direct would be Spark vs. Storm, which has been discussed
> here.
> http://marc.info/?l=hadoop-user&m=140434265901449
> Regards,
> Shahab
> On Fri, Apr 10, 2015 at 1:08 AM, Ashutosh Kumar <ashutosh.k78@gmail.com>
> wrote:
>> How do I decide whether I should go for Hadoop or Spark for a greenfield
>> project . I tried to find out and looks like Spark can do everything that
>> hadoop can do. Appreciate your thoughts on it.
>> Thanks

View raw message