flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-4696) Limit the number of Akka Dispatcher Threads in LocalMiniCluster
Date Tue, 27 Sep 2016 12:53:20 GMT
Stephan Ewen created FLINK-4696:
-----------------------------------

             Summary: Limit the number of Akka Dispatcher Threads in LocalMiniCluster
                 Key: FLINK-4696
                 URL: https://issues.apache.org/jira/browse/FLINK-4696
             Project: Flink
          Issue Type: Bug
          Components: Distributed Coordination
    Affects Versions: 1.2.0
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.2.0


By default, akka spawns 2x or 3x the number of cores in threads.

For the LocalFlinkMiniCluster, running on Travis (often 64 cores), with separate actor systems
for jobmanager and multiple taskmanagers, this frequetly means >600 akka threads. Flink
uses about 4 actors.

This simply eats unnecessary resources. I suggest to have at most 4 threads per actor system
in test setups.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message