Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 420D5200D5B for ; Wed, 29 Nov 2017 01:57:51 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 40B24160C15; Wed, 29 Nov 2017 00:57:51 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 8733C160BE7 for ; Wed, 29 Nov 2017 01:57:50 +0100 (CET) Received: (qmail 99815 invoked by uid 500); 29 Nov 2017 00:57:49 -0000 Mailing-List: contact dev-help@reef.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@reef.apache.org Delivered-To: mailing list dev@reef.apache.org Received: (qmail 99793 invoked by uid 99); 29 Nov 2017 00:57:49 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Nov 2017 00:57:49 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 93E4D18060F for ; Wed, 29 Nov 2017 00:57:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.129 X-Spam-Level: *** X-Spam-Status: No, score=3.129 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id lsNRuSpcST6N for ; Wed, 29 Nov 2017 00:57:47 +0000 (UTC) Received: from mail-pl0-f42.google.com (mail-pl0-f42.google.com [209.85.160.42]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 9E6B05F239 for ; Wed, 29 Nov 2017 00:57:46 +0000 (UTC) Received: by mail-pl0-f42.google.com with SMTP id i6so1022064plt.13 for ; Tue, 28 Nov 2017 16:57:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=sbpkMLTLPWqY1wSwkiakyT4hboV6ePWhaI3VnqjYZLg=; b=j3S6fhLv4/qqrSJP6LhqE6tOiKSv7cm1PJDqx6rvEd+Lzn+JxgYn9Y+3JYg+vts2cd //3VRPYLQHx3IiPtHRPbluueuKEwFbKftN3Xs2ViwZekHMgQDpuMZlONXHfaiT0bnmph U5Fl5DLavRF05vBbCOJH/TejOv+ulJ0ZcWAZPpFAY/kj7M1ZKWimkSeii8CwsYKBBL69 Xhes1MCSuqcQEwP5Vo3v3wLm77L0n771ifZ9/R2b19ks8N/Qq1olW5POA5yxBK7CKuXk bnSdmUQjrzG6YX5oA7AIOhHGEwY1/4m9Mps8+QeqgPCSFLZn1HLH7fsZ8EvuewfJiRju BcBQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=sbpkMLTLPWqY1wSwkiakyT4hboV6ePWhaI3VnqjYZLg=; b=M9wLxbFYX1Wl0qIEef4Bwvr5N+AKQuibNUSADy21wiDEvEF3iA1SQTt4EtVXXUX2al HMnp0u4uAjM1EBGh/aJPhU5DvNnTg9+FGSyCddiwXRG04wgg6HJK5AqPtXChZekp5U/U ogu5XSvSrmMjOQZ3Bs5rvV3C4ZsjUaEg+YisswQihGW3eZPqWP7n4h1IBSs6JkIClO4P eq02ihxsROU6mEWenKqpuLNRELXqrn9K5E04hwYsIxCM51B2SvUuxfDnZ8V+7HAAxH3S xKpD8PKYA1/3OpYoODOY8jsn/7S8IoZ9NAl5SOfs/ticfB5bGkY67oL01rO+L/FthlOS 7LjA== X-Gm-Message-State: AJaThX6pvCRFLqVuShgHPXPCQY6nhs3NlxKQE3bW8bX3RPsUC+/ZcSKu z3Tvcwm4BomO4iWDSYalGYepL28tF6Qly9f0tLw= X-Google-Smtp-Source: AGs4zMaf0CUQYJ9T761amkTecAcgg0vPxS24vqRwMZ7Ul6VRKhkEzd5YkJXCBm4qQUoJHIhUc48/Sh1zwISsLslYS2A= X-Received: by 10.159.231.22 with SMTP id w22mr1044476plq.125.1511917064543; Tue, 28 Nov 2017 16:57:44 -0800 (PST) MIME-Version: 1.0 Received: by 10.100.162.38 with HTTP; Tue, 28 Nov 2017 16:57:44 -0800 (PST) In-Reply-To: References: From: Saikat Kanjilal Date: Tue, 28 Nov 2017 16:57:44 -0800 Message-ID: Subject: Re: Launching reef evaluators, continuation of reef-1791 To: dev@reef.apache.org Content-Type: multipart/alternative; boundary="089e082d73c08fe28c055f149fb2" archived-at: Wed, 29 Nov 2017 00:57:51 -0000 --089e082d73c08fe28c055f149fb2 Content-Type: text/plain; charset="UTF-8" Never mind, figured it out :). Thanks On Mon, Nov 27, 2017 at 8:28 PM, Saikat Kanjilal wrote: > Hi Reef Experts, > Am getting back into implementing and testing reef-1791 finally again > based on the last PR feedback from Sergiy, had a contextual question I am > looking at some code to reuse to launch the reef evaluators that looks > something like the following: > > final REEFLauncher launcher = getREEFLauncher(args[0]); > > Thread.setDefaultUncaughtExceptionHandler(new REEFUncaughtExceptionHandler(launcher.envConfig)); > > try (final REEFEnvironment reef = REEFEnvironment.fromConfiguration(launcher.envConfig)) { > reef.run(); > } > > I am wondering whether there are other more efficient ways to launch the REEF Evaluators other than driven off a configuration file. In thinking about this some more I'd ideally want to launch the evalutors using a dynamic configuration. > > I looked through the REEF Common code and didn't see anything, my goal is to launch the REEF Evaluators in the spark runtime piggybacking off of the spark internal configs. > > Thanks in advance for your help. > > --089e082d73c08fe28c055f149fb2--