flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maximilian Michels (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3134) Make YarnJobManager's allocate call asynchronous
Date Mon, 07 Dec 2015 16:06:10 GMT
Maximilian Michels created FLINK-3134:

             Summary: Make YarnJobManager's allocate call asynchronous
                 Key: FLINK-3134
                 URL: https://issues.apache.org/jira/browse/FLINK-3134
             Project: Flink
          Issue Type: Bug
          Components: YARN Client
    Affects Versions: 0.10.1, 0.10.0, 1.0.0
            Reporter: Maximilian Michels
            Assignee: Maximilian Michels
             Fix For: 1.0.0

The {{allocate()}} call is used in the {{YarnJobManager}} to send a heartbeat to the YARN
resource manager. This call may block the JobManager actor system for arbitrary time, e.g.
if retry handlers are set up within the call to allocate.

I propose to use the {{AMRMClientAsync}}'s callback methods to send heartbeats and update
the container information. The API is available for our supported Hadoop versions (2.3.0 and


This message was sent by Atlassian JIRA

View raw message