Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E1036200BA4 for ; Sat, 15 Oct 2016 18:47:52 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id DFC54160AF1; Sat, 15 Oct 2016 16:47:52 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 30B9F160AD9 for ; Sat, 15 Oct 2016 18:47:52 +0200 (CEST) Received: (qmail 71703 invoked by uid 500); 15 Oct 2016 16:47:51 -0000 Mailing-List: contact dev-help@aurora.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@aurora.apache.org Delivered-To: mailing list dev@aurora.apache.org Received: (qmail 71053 invoked by uid 99); 15 Oct 2016 16:47:50 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 15 Oct 2016 16:47:50 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 3C8961A048F for ; Sat, 15 Oct 2016 16:47:50 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 6jb2UQOgTBob for ; Sat, 15 Oct 2016 16:47:48 +0000 (UTC) Received: from mail-wm0-f47.google.com (mail-wm0-f47.google.com [74.125.82.47]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 6DB7D5FC5F for ; Sat, 15 Oct 2016 16:47:48 +0000 (UTC) Received: by mail-wm0-f47.google.com with SMTP id d128so34968907wmf.1 for ; Sat, 15 Oct 2016 09:47:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=VmPeJHDgFpFQEZzCCdnO62vKOgj+Z1P9JOvtZwsLN2w=; b=t3VifkIFr0F2f+detXk7196Kx/8wbvAjcWQwaSESxfCCG+A5aeMQQHSeR5YEDQK9MU VZu3TPTVr8JVATF/s89FTPyk+5IZvtpZGcICLXFhUDsv6qd6MQcte6kCZarO5qfR1BhV N1rTIivdJu6x9P1x+RaVnKIgyjpxpg00x28V1zJ77mskO2hIjv3Tr5DhfMoh45lFscjn AtcllkBDyMqddD/ycKy8LrfkCwqvWSoSau1U8Kja2uVpJztx2YyJEcUwwPbxeXnFRdn+ 1eK6NEGEuVIQiwLB4ZXfpvkKMZnpWYOINIqxaGQyd2Di2WJ/EmY8wCnps7YoHd1KAEQw IAgg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=VmPeJHDgFpFQEZzCCdnO62vKOgj+Z1P9JOvtZwsLN2w=; b=GjYioqnSjU9anpIuD91/4hNvVrpasVDYjD3skXKos4qnduePglXuUCIsYKsMwq3jxC 6dslFEC7IIwOURwD9YKb0SbAzGX+JBk751LT0tsQYUz1eRPVZNhdVWl+IsG9PMTut/Rx 54HbKnZ3VvOGCFXdfSXW/gEXets9pMEjDdFhvLiHdIyA4OtDUU/Byya+/q3rUibHPANP z0Bh9WlXQcjRh8RTLPV1mASu245B8tbSHw3MjyEyHwck+qk7LBKzq6g96tvPUy/WPBvM XnNA8rnoqrQ1p+IgqXS/FIoTpBFwgo83qOKW2HxBy+w3CfEdC1GwoP0NyDQdnxRcfmTO 2uaQ== X-Gm-Message-State: AA6/9RnLQz9NVEMIEJH1mlBcIy5em86KcAsxRKAGzS+cW20G+wBlXfegZ0FN6p0x+l98xUQuDhGh8wZiwtWx8g== X-Received: by 10.194.55.65 with SMTP id q1mr5919122wjp.45.1476550057310; Sat, 15 Oct 2016 09:47:37 -0700 (PDT) MIME-Version: 1.0 Received: by 10.80.136.85 with HTTP; Sat, 15 Oct 2016 09:47:36 -0700 (PDT) In-Reply-To: References: From: Mangirish Wagle Date: Sat, 15 Oct 2016 12:47:36 -0400 Message-ID: Subject: Re: Need inputs on scheduling To: dev@aurora.apache.org Content-Type: multipart/alternative; boundary=089e01494214a8c24e053eea1948 archived-at: Sat, 15 Oct 2016 16:47:53 -0000 --089e01494214a8c24e053eea1948 Content-Type: text/plain; charset=UTF-8 Hi Santhosh, Thanks for your response and suggestion. Mesos-hydra is not being used and supported by the community anymore, from what I heard from Mesos developers. But certainly it may be a potential reference to build up upon. My most preferred option would be to use any existing schedulers like Apache Aurora to run MPI. If you have any insights on that, that would be really helpful. Regards, Mangirish On Sat, Oct 15, 2016 at 11:07 AM, Santhosh Kumar Shanmugham < sshanmugham@twitter.com.invalid> wrote: > Have you checked out https://github.com/mesosphere/mesos-hydra? > > On Oct 14, 2016 6:08 PM, "Mangirish Wagle" > wrote: > > > Thanks for your response Zameer. I shall check out Apache Aurora and > update > > if it served the purpose. > > > > On Fri, Oct 14, 2016 at 2:01 PM, Zameer Manji wrote: > > > > > Hey, > > > > > > I am not an expert on MPI jobs, but it seems possible to run them on > > > Aurora. Aurora is a pretty flexible scheduler that lets you run > arbitrary > > > binaries or container images. Aurora is designed for long running > > services > > > and assuming that you want to launch workers that are long running, it > > > could solve your problem. > > > > > > On Thu, Oct 13, 2016 at 11:12 PM, Mangirish Wagle < > > > vaglomangirish@gmail.com> > > > wrote: > > > > > > > Hello Aurora Devs, > > > > > > > > I am contributing to Apache Airavata > and > > > > currently working on extending the support for the science gateways > to > > > run > > > > MPI jobs on cloud based Mesos clusters. > > > > > > > > Is there a way I can achieve this using Apache Aurora? I would really > > > > appreciate if you could share info on any work already being done to > > > > achieve scheduling MPI jobs on Mesos. > > > > > > > > Thank you. > > > > > > > > Best Regards, > > > > Mangirish Wagle > > > > Graduate Student, Indiana University Bloomington > > > > > > > > -- > > > > Zameer Manji > > > > > > > > > > --089e01494214a8c24e053eea1948--