spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Petar Petrov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-23182) Allow enabling of TCP keep alive for master RPC connections
Date Mon, 22 Jan 2018 22:04:01 GMT
Petar Petrov created SPARK-23182:
------------------------------------

             Summary: Allow enabling of TCP keep alive for master RPC connections
                 Key: SPARK-23182
                 URL: https://issues.apache.org/jira/browse/SPARK-23182
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 2.2.0
            Reporter: Petar Petrov


We rely heavily on preemptible worker machines in GCP/GCE. These machines disappear without
closing the TCP connections to the master which increases the number of established connections
and new workers can not connect because of "Too many open files" on the master.

To solve the problem we need to enable TCP keep alive for the RPC connections to the master
but it's not possible to do so via configuration.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message