Return-Path: X-Original-To: apmail-mesos-user-archive@www.apache.org Delivered-To: apmail-mesos-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 519A710BD2 for ; Fri, 6 Dec 2013 19:38:36 +0000 (UTC) Received: (qmail 38585 invoked by uid 500); 6 Dec 2013 19:38:36 -0000 Delivered-To: apmail-mesos-user-archive@mesos.apache.org Received: (qmail 38562 invoked by uid 500); 6 Dec 2013 19:38:36 -0000 Mailing-List: contact user-help@mesos.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@mesos.apache.org Delivered-To: mailing list user@mesos.apache.org Received: (qmail 38554 invoked by uid 99); 6 Dec 2013 19:38:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Dec 2013 19:38:36 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ceteri@gmail.com designates 209.85.223.180 as permitted sender) Received: from [209.85.223.180] (HELO mail-ie0-f180.google.com) (209.85.223.180) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Dec 2013 19:38:30 +0000 Received: by mail-ie0-f180.google.com with SMTP id tp5so2079130ieb.39 for ; Fri, 06 Dec 2013 11:38:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=WdDPNmMs8ByzkDLECMWcfIRo22oGija2KPn6B3BRGXg=; b=pDk7LCyhzE7qz672WkdgmmJthClhAmdNVVfZGT4ojRSxRiKfe25xu9uJYciRiGlh5m i2ROAraJgNzvgx5jjEiAF5Zrh1i5AQyVYAtOYxVPMfmsHHFKxgUOcwV6xpOx8/tpYRe3 2+zxXtcbr5ok4mJigb1QElHHKy3xbNEuG7b6Rs2oBofOTFi1W6qCFABQH4hpyqgpd2Tx FWBSi+BWqSEMNIf6TjAihvFZ9WUvMKC/Vr9MX0PO42pcjpbH5YVJL8LPZvifzcePsmQK l9UOcGVPn4hCw92nHS+Kfk/K1ysoADPjIeUnqtNB53l59fgxgxv8Pi2Urx0vkcpkJeJR clcA== X-Received: by 10.50.115.35 with SMTP id jl3mr4299390igb.37.1386358689184; Fri, 06 Dec 2013 11:38:09 -0800 (PST) MIME-Version: 1.0 Received: by 10.50.237.7 with HTTP; Fri, 6 Dec 2013 11:37:29 -0800 (PST) In-Reply-To: References: From: Paco Nathan Date: Fri, 6 Dec 2013 11:37:29 -0800 Message-ID: Subject: Re: Running Hadoop MRv2 on Mesos To: user Content-Type: multipart/alternative; boundary=089e01183fcc33502404ece2c95e X-Virus-Checked: Checked by ClamAV on apache.org --089e01183fcc33502404ece2c95e Content-Type: text/plain; charset=ISO-8859-1 +1 On Fri, Dec 6, 2013 at 11:19 AM, Vinod Kone wrote: > I am unaware of any ongoing efforts related to this though this request > came up a few times before. Maybe we could do this in our next (whenever it > happens to be) Mesos hackathon! > > > On Fri, Dec 6, 2013 at 11:46 PM, Aaron Gottlieb > wrote: > >> Hi, >> >> >> >> I was wondering if there is any current work/support for running Hadoop >> MRv2 on a Mesos Cluster. >> >> >> >> I do not mean running YARN, but running what the old JobTracker and >> TaskTrackers have become: MRAppMaster and its containers. >> >> >> >> Mesos uses a pluggable scheduler to work with the Hadoop MRv1 JobTracker, >> but this does not allow taking advantage of any current work being done to >> improve the MapReduce framework from Hadoop, as that seems to be closely >> integrated with YARN. >> >> >> >> Does anyone know if there is any project regarding integrating the new >> Hadoop MRv2 with Mesos? Or does anyone have any idea which components of >> MRAppMaster (the ApplicationManager for MapReduce jobs in YARN) might be >> taken to alter to allow it to be used with Mesos instead of YARN? >> >> >> >> (My google, stackoverflow, and mailing list search have revealed nothing >> so far except comparisons of Mesos and YARN.) >> >> >> >> Thanks, >> >> >> >> Aaron >> >> >> > > --089e01183fcc33502404ece2c95e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
+1


On Fri, Dec 6, 2013 at 11:19 AM, Vinod Kone &= lt;vinodkone@gmail= .com> wrote:
I am unaware of any ongoing= efforts related to this though this request came up a few times before. Ma= ybe we could do this in our next (whenever it happens to be) Mesos hackatho= n!


On Fri, Dec 6, 2013 at 11:46 PM, Aaron G= ottlieb <aagottlieb@valueclick.com> wrote:

Hi,

=A0

I was wondering if there is any current work/support= for running Hadoop MRv2 on a Mesos Cluster.

=A0

I do not mean running YARN, but running what the old= JobTracker and TaskTrackers have become: MRAppMaster and its containers.

=A0

Mesos uses a pluggable scheduler to work with the Ha= doop MRv1 JobTracker, but this does not allow taking advantage of any curre= nt work being done to improve the MapReduce framework from Hadoop, as that = seems to be closely integrated with YARN.

=A0

Does anyone know if there is any project regarding i= ntegrating the new Hadoop MRv2 with Mesos?=A0 Or does anyone have any idea = which components of MRAppMaster (the ApplicationManager for MapReduce jobs = in YARN) might be taken to alter to allow it to be used with Mesos instead of YARN?

=A0

(My google, stackoverflow, and mailing list search h= ave revealed nothing so far except comparisons of Mesos and YARN.)

=A0

Thanks,<= /font>

=A0

Aaron

=A0



--089e01183fcc33502404ece2c95e--