reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boris Shulman (JIRA)" <>
Subject [jira] [Commented] (REEF-1356) Create MultiRuntime Configuration Builder for c#
Date Mon, 25 Apr 2016 20:07:12 GMT


Boris Shulman commented on REEF-1356:

Configuration is the driver side configuration, and you are right it shouldn't be optional.
For SetSubmissionRuntime this is client side configuration. We need that to allow configuring
HDI properties for example. I prefer to submit the properties to teh builder and get a prepared
REEFClient instead of configuring it the way we do it now.

> Create MultiRuntime Configuration Builder for c#
> ------------------------------------------------
>                 Key: REEF-1356
>                 URL:
>             Project: REEF
>          Issue Type: Sub-task
>          Components: REEF
>            Reporter: Boris Shulman
>            Assignee: Boris Shulman
> The purpose of this Jira is creating a mechanism for MultiRuntime Job Submission.
> MultiRuntimeConfiguration builder will expose the following interface:
> {code}
> MultiRuntimeConfigurationBuilder
> {
>         public MultiRuntimeConfigurationBuilder AddRuntime(
>                  RuntimeName runtimeName, 
>                  IConfiguration configuration = null);
>         public MultiRuntimeConfigurationBuilder SetDefaultRuntime(
>                   RuntimeName runtimeName);
>         public MultiRuntimeConfigurationBuilder SetSubmissionRuntime(
>                   SubmissionRuntimeName runtimeName, 
>                  IConfiguration configuration);
> }
> {code}
> In addition each supported runtime/submission runtime will provide an execution/submission
runtime configuration builder. As not each runtime requires additional configuration for execution
runtime (Yarn for example), this parameter is optional on the interface.
> In order to add additional execution runtime we will need to create a execution runtime
builder,  add it to the avro schema and alter the bootstrapping code to support it.
> Adding new submission runtime is a more complex process as new bootstrap code is required.

This message was sent by Atlassian JIRA

View raw message