reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mariia Mykhailova (JIRA)" <>
Subject [jira] [Updated] (REEF-751) Add a standard way to provide cluster-local configuration
Date Tue, 26 Jan 2016 18:30:39 GMT


Mariia Mykhailova updated REEF-751:
    Labels: GSoC  (was: )

> Add a standard way to provide cluster-local configuration
> ---------------------------------------------------------
>                 Key: REEF-751
>                 URL:
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF Client, REEF.NET Client
>            Reporter: Markus Weimer
>              Labels: GSoC
> When running a REEF application on a specific cluster, we sometimes have to make cluster-specific
configuration choices beyond what's available via e.g. the YARN Configuration. One example
are clusters which only allow us to open TCP ports in a specific range.
> Right now, we require the application to add such configuration to the Driver, e.g. via
the {{DriverConfigurationProviders}} mechanism. This is awkward, because it limits the portability
of applications: In order for an app to run such a cluster, one would have to change the app's
code. This is undesirable.
> Instead, we should have a standard mechanism by which one can provide additional runtime-level
configuration to be picked up by the REEF client. Let's use this JIRA to discuss potential
solutions to this issue.

This message was sent by Atlassian JIRA

View raw message