reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Markus Weimer (JIRA)" <>
Subject [jira] [Commented] (REEF-1356) Create MultiRuntime Configuration Builder for c#
Date Mon, 25 Apr 2016 20:02:12 GMT


Markus Weimer commented on REEF-1356:

In {{AddRuntime}}, what is the {{configuration}}? Is this the Driver-side of the runtime configuration?
For Java or C#? Also, why is it optional?

In {{SetSubmissionRuntime}}, the {{configuration}} is the client side configuration? Why would
we need this? I'd expect that I could use whichever client to submit a Driver which happens
to use the multi-runtime. To that end, maybe rename the new interface {{MultiRuntimeDriverConfigurationBuilder}}?

On the name itself: Does it actually {{.Build()}} a {{IConfiguration}}? Otherwise {{ConfigurationBuilder}}
is a misleading suffix for the name.

> Create MultiRuntime Configuration Builder for c#
> ------------------------------------------------
>                 Key: REEF-1356
>                 URL:
>             Project: REEF
>          Issue Type: Sub-task
>          Components: REEF
>            Reporter: Boris Shulman
>            Assignee: Boris Shulman
> The purpose of this Jira is creating a mechanism for MultiRuntime Job Submission.
> MultiRuntimeConfiguration builder will expose the following interface:
> {code}
> MultiRuntimeConfigurationBuilder
> {
>         public MultiRuntimeConfigurationBuilder AddRuntime(
>                  RuntimeName runtimeName, 
>                  IConfiguration configuration = null);
>         public MultiRuntimeConfigurationBuilder SetDefaultRuntime(
>                   RuntimeName runtimeName);
>         public MultiRuntimeConfigurationBuilder SetSubmissionRuntime(
>                   SubmissionRuntimeName runtimeName, 
>                  IConfiguration configuration);
> }
> {code}
> In addition each supported runtime/submission runtime will provide an execution/submission
runtime configuration builder. As not each runtime requires additional configuration for execution
runtime (Yarn for example), this parameter is optional on the interface.
> In order to add additional execution runtime we will need to create a execution runtime
builder,  add it to the avro schema and alter the bootstrapping code to support it.
> Adding new submission runtime is a more complex process as new bootstrap code is required.

This message was sent by Atlassian JIRA

View raw message