flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maximilian Michels (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3134) Make YarnJobManager's allocate call asynchronous
Date Mon, 07 Dec 2015 16:06:10 GMT
Maximilian Michels created FLINK-3134:
-----------------------------------------

             Summary: Make YarnJobManager's allocate call asynchronous
                 Key: FLINK-3134
                 URL: https://issues.apache.org/jira/browse/FLINK-3134
             Project: Flink
          Issue Type: Bug
          Components: YARN Client
    Affects Versions: 0.10.1, 0.10.0, 1.0.0
            Reporter: Maximilian Michels
            Assignee: Maximilian Michels
             Fix For: 1.0.0


The {{allocate()}} call is used in the {{YarnJobManager}} to send a heartbeat to the YARN
resource manager. This call may block the JobManager actor system for arbitrary time, e.g.
if retry handlers are set up within the call to allocate.

I propose to use the {{AMRMClientAsync}}'s callback methods to send heartbeats and update
the container information. The API is available for our supported Hadoop versions (2.3.0 and
above).

https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/yarn/client/api/async/AMRMClientAsync.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message