reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boris Shulman (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (REEF-1054) c# client implementation for multi-runtime
Date Mon, 04 Apr 2016 07:25:25 GMT

    [ https://issues.apache.org/jira/browse/REEF-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15223762#comment-15223762
] 

Boris Shulman edited comment on REEF-1054 at 4/4/16 7:24 AM:
-------------------------------------------------------------

My plan is as following:
1) Only native c# clients will be supported (for now it looks like only YarnRest and HDInsight).
2) A configuration builder will be provided (similar to the java side), which will allow to
configure the submission runtime, default runtime and list of provided runtimes (and additional
parameters like number of evaluators for local runtime).
3) The configuration builder will build a configuration with the MultiRuntimeREEFDotNetClient
as IREEFClient implementation.
4) MultiRuntimeREEFDotNetClient will use a configured XXXREEFDotNetClient client to launch
the job with proper configs (for now only yarn)
5) AvroYarnAppSubmissionParameters will be extended to support multiruntime configuration
6) Bootstrap config generator will be extended to generate multiruntime config.


was (Author: shulmanb):
My plan is as following:
1) Only native c# clients will be supported (for now it looks like only YarnRest and HDInsight).
2) A configuration builder will be provided (similar to the java side), which will allow to
configure the submission runtime, default runtime and list of provided runtimes (and additional
parameters like number of evaluators for local runtime).
3) The configuration builder will build a configuration with the MultiRuntimeREEFDotNetClient
as IREEFClient implementation.
4) MultiRuntimeREEFDotNetClient will use a configured XXXREEFDotNetClient client to launch
the job with proper configs (for now only yarn)
5) AvroYarnAppSubmissionParameters will be extanded to support multiruntime configuration
6) Bootstrap config generator will be extended to generate multiruntime config.

> c# client implementation for multi-runtime
> ------------------------------------------
>
>                 Key: REEF-1054
>                 URL: https://issues.apache.org/jira/browse/REEF-1054
>             Project: REEF
>          Issue Type: Sub-task
>          Components: REEF
>            Reporter: Boris Shulman
>            Assignee: Boris Shulman
>
> We need to expose launching multi-runtime jobs from c#. As multi-runtime currently supports
only Yarn as the submission runtime, I am thinking to piggyback on the Yarn submission implementation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message