mesos-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paco Nathan <cet...@gmail.com>
Subject Re: Running Hadoop MRv2 on Mesos
Date Fri, 06 Dec 2013 19:37:29 GMT
+1


On Fri, Dec 6, 2013 at 11:19 AM, Vinod Kone <vinodkone@gmail.com> wrote:

> I am unaware of any ongoing efforts related to this though this request
> came up a few times before. Maybe we could do this in our next (whenever it
> happens to be) Mesos hackathon!
>
>
> On Fri, Dec 6, 2013 at 11:46 PM, Aaron Gottlieb <aagottlieb@valueclick.com
> > wrote:
>
>>  Hi,
>>
>>
>>
>> I was wondering if there is any current work/support for running Hadoop
>> MRv2 on a Mesos Cluster.
>>
>>
>>
>> I do not mean running YARN, but running what the old JobTracker and
>> TaskTrackers have become: MRAppMaster and its containers.
>>
>>
>>
>> Mesos uses a pluggable scheduler to work with the Hadoop MRv1 JobTracker,
>> but this does not allow taking advantage of any current work being done to
>> improve the MapReduce framework from Hadoop, as that seems to be closely
>> integrated with YARN.
>>
>>
>>
>> Does anyone know if there is any project regarding integrating the new
>> Hadoop MRv2 with Mesos?  Or does anyone have any idea which components of
>> MRAppMaster (the ApplicationManager for MapReduce jobs in YARN) might be
>> taken to alter to allow it to be used with Mesos instead of YARN?
>>
>>
>>
>> (My google, stackoverflow, and mailing list search have revealed nothing
>> so far except comparisons of Mesos and YARN.)
>>
>>
>>
>> Thanks,
>>
>>
>>
>> Aaron
>>
>>
>>
>
>

Mime
View raw message