mesos-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Arnfeld <...@duedil.com>
Subject Re: Does Mesos support Hadoop MR V2
Date Fri, 25 Jul 2014 18:54:26 GMT
Hey Luyi,

That's correct, the Hadoop framework currently only supports Hadoop 2 MRv1.
It also doesn't have great support for the HA jobtracker available in newer
versions of Hadoop, but I've been working on that the past few weeks.

I'm not sure how Hadoop 2 would play with Mesos, but very interested to
find out more. Am I correct in thinking MRv2 will only run on top of YARN?

I wonder if anyone else on the mailing list is running YARN on top of
Mesos...

Tom.

On Friday, 25 July 2014, Luyi Wang <wangluyi1982@gmail.com> wrote:

> Checked the mesos github(https://github.com/mesos/hadoop). It listed
> support for MapReduce V1
>
> How about the MR V2?
>
> Right now we are using cloudera to manage hadoop clusters where uses MRV2.
> We are planning to migrate all our services to mesos(still in the initial
> investigating stage).  Good suggestions, advice and experiences are
> welcomed.
>
> Thanks a lot!
>
>
> -Luyi.
>
>
>
>

Mime
View raw message