reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boris Shulman (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (REEF-1355) Adding extensibility to the YarnReefDotNetClient for Multi Runtime
Date Sat, 23 Apr 2016 21:30:12 GMT

     [ https://issues.apache.org/jira/browse/REEF-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Boris Shulman updated REEF-1355:
--------------------------------
    Description: 
The purpose of this Jira is adding extensibility mechanism to the YarnREEFDotNetClient.
It will allow:
1) Configuring different bootstrap class
2) Plugin in different Param Serialization mechanism. Both Appparameters and Job parameters.
3) Providing additional job driver configuration.

This will allow reusing c# YarRest/HDInsight submission mechanisms for MultiRuntime jobs in
those environments.
After the initial work for MultiRunitme C# client will be completed, we will be able to remove
the old Bootstrapping mechanism and use the multi runtme mechansim for all Yarn/HDI job submissions.

The main reason for keeping both mechanisms for now is allowing smaller commits while we are
working on this feature.


  was:
This will allow reusing c# YarRest/HDInsight submission mechanisms for MultiRuntime jobs in
those environments. The extensibility is in two places:
1) Allowing configuring different bootstrap class
2) Allowing plugin in different Param Serialization mechanism


> Adding extensibility to the YarnReefDotNetClient for Multi Runtime
> ------------------------------------------------------------------
>
>                 Key: REEF-1355
>                 URL: https://issues.apache.org/jira/browse/REEF-1355
>             Project: REEF
>          Issue Type: Sub-task
>          Components: REEF
>            Reporter: Boris Shulman
>            Assignee: Boris Shulman
>
> The purpose of this Jira is adding extensibility mechanism to the YarnREEFDotNetClient.
> It will allow:
> 1) Configuring different bootstrap class
> 2) Plugin in different Param Serialization mechanism. Both Appparameters and Job parameters.
> 3) Providing additional job driver configuration.
> This will allow reusing c# YarRest/HDInsight submission mechanisms for MultiRuntime jobs
in those environments.
> After the initial work for MultiRunitme C# client will be completed, we will be able
to remove the old Bootstrapping mechanism and use the multi runtme mechansim for all Yarn/HDI
job submissions.
> The main reason for keeping both mechanisms for now is allowing smaller commits while
we are working on this feature.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message