Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A66DA11D4F for ; Wed, 23 Apr 2014 17:04:31 +0000 (UTC) Received: (qmail 50183 invoked by uid 500); 23 Apr 2014 17:04:21 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 50069 invoked by uid 500); 23 Apr 2014 17:04:21 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 50060 invoked by uid 99); 23 Apr 2014 17:04:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Apr 2014 17:04:21 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of oleg.zhurakousky@gmail.com designates 74.125.82.45 as permitted sender) Received: from [74.125.82.45] (HELO mail-wg0-f45.google.com) (74.125.82.45) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Apr 2014 17:04:16 +0000 Received: by mail-wg0-f45.google.com with SMTP id l18so1121860wgh.4 for ; Wed, 23 Apr 2014 10:03:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=rTTQOEpuFXgbaIPpba1B3ZUPEE06G+7Nik5D9DoH9T8=; b=GLhNL0tRnxbmsL06QILEYyhiuCsUzsXORekWCQ7xRC4GFfGCeTqLf7e0JMiuizCg4X KjjuUVu5dUdcmk5AN5w+E8EB2vzr6jkgTOzfpQS87YmeT3EKnev2GJTOtNl1/A4CyWWa +4ZaXpfCowIzrA8ZN2lrwqohXW6A3CYm7EQ7shGZCwB3KiI7W8PMGV3dzQryd9QAur2U rvwuQBOPXJ047TpRfIJqf0l7oCcmqsA3LHSjhUTus3Yi3YMbYtpJHadEkQW57PI5QS4j 1aRS3s2hJyM888EDu0XGLlvZlm2QfLXsi5RPXuacMXLaznOLuGV95RiCAnh/d+piZFGy b5cg== MIME-Version: 1.0 X-Received: by 10.194.90.39 with SMTP id bt7mr4786wjb.93.1398272635745; Wed, 23 Apr 2014 10:03:55 -0700 (PDT) Received: by 10.180.0.148 with HTTP; Wed, 23 Apr 2014 10:03:55 -0700 (PDT) In-Reply-To: References: Date: Wed, 23 Apr 2014 13:03:55 -0400 Message-ID: Subject: Re: Reuse of YARN container From: Oleg Zhurakousky To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7bfceec2c0bae004f7b8b7fa X-Virus-Checked: Checked by ClamAV on apache.org --047d7bfceec2c0bae004f7b8b7fa Content-Type: text/plain; charset=UTF-8 While YARN-373 addresses a bit of a different problem the use case of reuse of existing resources could be looked at few different ways. As I understand YARN-373 talks about reusing resources from an old container to spun off a new one. Another way of looking at the problem is to actually reuse a container itself as long as you can communicate with it. I've been experimenting with it recently and while I am not sure if the approach is valid or solves your use case, take a look here https://github.com/olegz/yaya/wiki/CoreFeatures#java-based-long-running-and-interact-able-application-containers. At least you'll get some ideas of what could be done. Cheers Oleg On Tue, Apr 8, 2014 at 10:53 AM, Krishna Kishore Bonagiri < write2kishore@gmail.com> wrote: > Hi, > > Does this JIRA issue mean that we can't currently reuse a container for > running/launching two different processes one after another? > > https://issues.apache.org/jira/browse/YARN-373 > > > If that is true, are there any plans for making that possible? > > Thanks, > Kishore > --047d7bfceec2c0bae004f7b8b7fa Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
While YARN-373 addresses a bit of a different problem the = use case of reuse of existing resources could be looked at few different wa= ys. As I understand YARN-373 talks about reusing resources from an old cont= ainer to spun off a new one. Another way of looking at the problem is to ac= tually reuse a container itself as long as you can communicate with it. I've been experimenting with it recently and while I am not sure if the= approach is valid or solves your use case, take a look here=C2=A0https://github.com/olegz/yaya/wi= ki/CoreFeatures#java-based-long-running-and-interact-able-application-conta= iners. At least you'll get some ideas of what could be done.

Cheers
Oleg


On Tue, Apr 8, 2014 at 10:53 AM, Kr= ishna Kishore Bonagiri <write2kishore@gmail.com> wrote= :
Hi,

=C2=A0 =C2=A0Does this JIRA issue mean that we can't currently r= euse a container for running/launching two different processes one after an= other?=C2=A0

https://issues.apache.org/jira/browse/YARN-373


=C2=A0 If that is true, are there any pl= ans for making that possible?

Thanks,
Ki= shore

--047d7bfceec2c0bae004f7b8b7fa--