flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-5253) Remove special treatment of "dynamic properties"
Date Mon, 05 Dec 2016 01:59:58 GMT
Stephan Ewen created FLINK-5253:

             Summary: Remove special treatment of "dynamic properties"
                 Key: FLINK-5253
                 URL: https://issues.apache.org/jira/browse/FLINK-5253
             Project: Flink
          Issue Type: Sub-task
          Components: YARN
         Environment: {{flip-6}} feature branch
            Reporter: Stephan Ewen

The YARN client accepts configuration keys as command line parameters.

Currently these are send to the AppMaster and TaskManager as "dynamic properties", encoded
in a special way via environment variables.

The mechanism is quite fragile. We should simplify it:

  - The YARN client takes the local {{flink-conf.yaml}} as the base.
  - It overwrite config entries with command line properties when preparing the configuration
to be shipped to YARN container processes (JM / TM)
  - No additional handling neccessary

This message was sent by Atlassian JIRA

View raw message