reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Markus Weimer (JIRA)" <>
Subject [jira] [Commented] (REEF-1828) An Extension that Allows Users to Provide Start Scripts for an Evaluator
Date Wed, 19 Jul 2017 14:36:00 GMT


Markus Weimer commented on REEF-1828:

All command lines REEF uses to launch Java or .NET Evaluators are built using implementations
of {{org.apache.reef.runtime.common.launch.LaunchCommandBuilder}}. That should give us a hook
where we can add the script generation.

One challenge with generating scripts will be cross-OS support. On UNIXoid OSs, we'd generate
shell scripts, on Windows, we'd have to generate {{.bat}} files.

> An Extension that Allows Users to Provide Start Scripts for an Evaluator
> ------------------------------------------------------------------------
>                 Key: REEF-1828
>                 URL:
>             Project: REEF
>          Issue Type: Wish
>          Components: REEF Evaluator
>    Affects Versions: 0.15
>            Reporter: Shouheng Yi
>            Priority: Minor
> I've been working with REEF on a cluster for a recent project. One of the common themes
I observed is that I have to configure the machines which REEF evaluators reside on, for example,
opening ports, modifying firewall rules, etc.
> I couldn't easily find a place to do so in REEF. Therefore the only option I'm aware
of is to modify REEF's source code and embed a custom process to run the scripts. This practice
is neither safe nor proper.
> My argument for this extension is that users will have different needs and settings on
their clusters - which is something that we couldn't predict. It will be nice if we offer
users some freedom to plug in some customized scripts for them to set up the cluster according
to their needs, of course, in a safe fashion managed by REEF.
> I'm wondering if we are open to this idea. Thanks.

This message was sent by Atlassian JIRA

View raw message